Pseudo NLP Joint Spam Classification Technique for Big Data Cluster
Source abstract
Abstract
Spam mail classification considered complex and error-prone task in the distributed computing environment. There are various available spam mail classification approaches such as the naive Bayesian classifier, logistic regression and support vector machine and decision tree, recursive neural network, and long short-term memory algorithms. However, they do not consider the document when analyzing spam mail content. These approaches use the bag-of-words method, which analyzes a large amount of text data and classifies features with the help of term frequency-inverse document frequency. Because there are many words in a document, these approaches consume a massive amount of resources and become infeasible when performing classification on multiple associated mail documents together. Thus, spam mail is not classified fully, and these approaches remain with loopholes. Thus, we propose a term frequency topic inverse document frequency model that considers the meaning of text data in a larger semantic unit by applying weights based on the document’s topic. Moreover, the proposed approach reduces the scarcity problem through a frequency topic-inverse document frequency in singular value decomposition model. Our proposed approach also reduces the dimensionality, which ultimately increases the strength of document classification. Experimental evaluations show that the proposed approach classifies spam mail documents with higher accuracy using individual document-independent processing computation. Comparative evaluations show that the proposed approach performs better than the logistic regression model in the distributed computing environment, with higher document word frequencies of 97.05%, 99.17% and 96.59%.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Spam and Phishing Detection · Text and Document Classification Technologies · Sentiment Analysis and Opinion Mining
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (29)
Show source-provided references
1. A study on spam mail regulation policy in cyberspace
2. Spam mail flooding and regulatory measures
3. Optimization of classification criteria considering asymmetric error costs and an intelligent intrusion detection model based on SVMs
4. Botnet spam e-mail detection using deep recurrent neural network10.30534/ijeter/2020/83852020 ↗
5. Spam detection approach for secure mobile message communication using machine learning algorithms
6. Language models, smoothing, and IDF weighting
7. Performance analysis of ANN and naive bayes classification algorithm for data classification10.18201/ijisae.2019252786 ↗
8. A modified poisson regression approach to prospective studies with binary data10.1093/aje/kwh090 ↗
9. A simulation study of the number of events per variable in logistic regression analysis10.1016/S0895-4356(96)00236-3 ↗
10. LIBLINEAR: A library for large linear classification
11. Additive logistic regression: A statistical view of boosting10.1214/aos/1016218223 ↗
12. Classification criteria for psoriatic arthritis: Development of new criteria from a large international study10.1002/art.21972 ↗
13. Random forests for classification in ecology
14. Ensemble of keyword extraction methods and classifiers in text classification10.1016/j.eswa.2016.03.045 ↗
15. A multiobjective weighted voting ensemble classifier based on differential evolution algorithm for text sentiment classification10.1016/j.eswa.2016.06.005 ↗
16. Comparison research on text pre-processing methods on twitter sentiment analysis10.1109/ACCESS.2017.2672677 ↗
17. A co-classification approach to learning from multilingual corpora10.1007/s10994-009-5151-5 ↗
18. Comparison of naive bayes, random forest, decision tree, support vector machines, and logistic regression classifiers for text reviews classification
19. Automatic document screening of medical literature using word and text embeddings in an active learning setting10.1007/s11192-020-03648-6 ↗
20. Adaptive intelligent learning approach based on visual anti-spam email model for multi-natural language10.1515/jisys-2021-0045 ↗
21. Implementing an agent-based multi-natural language anti-spam model
22. A comparison of goodness-of-fit tests for the logistic regression model10.1002/(SICI)1097-0258(19970515)16:9<965::AID-SIM509>3.0.CO;2-O ↗
23. Large-scale bayesian logistic regression for text categorization10.1198/004017007000000245 ↗
24. Features reduction using logistic regression for spam filtering
25. An improvement to TF: Term distribution based term weight algorithm
26. Using TF-IDF to determine word relevance in document queries
27. A direct LDA algorithm for high-dimensional data—with application to face recognition10.1016/S0031-3203(00)00162-X ↗
28. Latent dirichlet allocation
29. On the validity of a new SMS spam collection