journal article·2020-01-31Open access

A Heterogeneous Ensemble Learning Framework for Spam Detection in Social Networks with Imbalanced Data

Chensu Zhao, Yang Xin, Xuefeng Li, Yixian Yang, Yuling Chen

Applied Sciences· Volume 10· Issue 3

Abstract

The popularity of social networks provides people with many conveniences, but their rapid growth has also attracted many attackers. In recent years, the malicious behavior of social network spammers has seriously threatened the information security of ordinary users. To reduce this threat, many researchers have mined the behavior characteristics of spammers and have obtained good results by applying machine learning algorithms to identify spammers in social networks. However, most of these studies overlook class imbalance situations that exist in real world data. In this paper, we propose a heterogeneous stacking-based ensemble learning framework to ameliorate the impact of class imbalance on spam detection in social networks. The proposed framework consists of two main components, a base module and a combining module. In the base module, we adopt six different base classifiers and utilize this classifier diversity to construct new ensemble input members. In the combination module, we introduce cost sensitive learning into deep neural network training. By setting different costs for misclassification and dynamically adjusting the weights of the prediction results of the base classifiers, we can integrate the input members and aggregate the classification results. The experimental results show that our framework effectively improves the spam detection rate on imbalanced datasets.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Spam and Phishing Detection · Internet Traffic Analysis and Secure E-voting · Text and Document Classification Technologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

National Engineering Laboratory for Disaster Backup and Recovery, Information Security Center, School of Cyberspace Security, Beijing University of Posts and Telecommunications, Beijing 100876, China

Guizhou Provincial Key Laboratory of Public Big Data, Guizhou University, Guizhou 550025, China

School of Information and Engineering, Shandong Yingcai University, Jinan 250104, China

Funding

National Key R&D Program of China under Grant · Major Scientific and Technological Special Project of Guizhou Province · Foundation of Guizhou Provincial Key Laboratory of Public Big Data

References (47)

Show source-provided references
1. Malicious accounts: Dark of the social networks10.1016/j.jnca.2016.11.030 ↗
2. Grier, C., Thomas, K., Paxson, V., and Zhang, M. (2010). @spam: the underground on 140 characters or less. Proceedings of the 17th ACM conference on Computer and communications security - CCS ’10, ACM Press.10.1145/1866307.1866311 ↗
3. Wang, G., Mohanlal, M., Wilson, C., Wang, X., Metzger, M., Zheng, H., and Zhao, B.Y. (2013). Social turing tests: Crowdsourcing sybil detection. Proceedings of the 20th Network & Distributed System Security Symposium (NDSS), The Internet Society.
4. Thomas, K., Grier, C., Ma, J., Paxson, V., and Song, D. (2011). Design and Evaluation of a Real-Time URL Spam Filtering Service. Proceedings of the 2011 IEEE Symposium on Security and Privacy, IEEE.10.1109/SP.2011.25 ↗
5. Ghosh, S., Viswanath, B., Kooti, F., Sharma, N.K., Korlam, G., Benevenuto, F., Ganguly, N., and Gummadi, K.P. (2012). Understanding and combating link farming in the twitter social network. Proceedings of the 21st international conference on World Wide Web - WWW ’12, ACM Press.10.1145/2187836.2187846 ↗
6. VoteTrust: Leveraging Friend Invitation Graph to Defend against Social Network Sybils10.1109/TDSC.2015.2410792 ↗
7. Ahmed, F., and Abulaish, M. (2012). An MCL-Based Approach for Spam Profile Detection in Online Social Networks. Proceedings of the 2012 IEEE 11th International Conference on Trust, Security and Privacy in Computing and Communications, IEEE.10.1109/TrustCom.2012.83 ↗
8. ‘Sandy’ If it looks like a spammer and behaves like a spammer, it must be a spammer: analysis and detection of microblogging spam accounts10.1007/s10207-016-0321-5 ↗
9. İş, H., and Tuncer, T. (2019). Interaction-Based Behavioral Analysis of Twitter Social Network Accounts. Appl. Sci., 9.10.3390/app9204448 ↗
10. Hussain, N., Turab Mirza, H., Rasool, G., Hussain, I., and Kaleem, M. (2019). Spam Review Detection Techniques: A Systematic Literature Review. Appl. Sci., 9.10.3390/app9050987 ↗
11. Addressing the class imbalance problem in Twitter spam detection using ensemble learning10.1016/j.cose.2016.12.004 ↗
12. Learning from class-imbalanced data: Review of methods and applications10.1016/j.eswa.2016.12.035 ↗
13. Online feature selection for high-dimensional class-imbalanced data10.1016/j.knosys.2017.09.006 ↗
14. (2019, October 27). Twitter Study. Available online: http://pearanalytics.com/wp-content/uploads/2012/12/Twitter-Study-August-2009.pdf.
15. Jin, Z., Li, Q., Zeng, D., and Wang, L. (2015). Filtering spam in Weibo using ensemble imbalanced classification and knowledge expansion. Proceedings of the 2015 IEEE International Conference on Intelligence and Security Informatics (ISI), IEEE.10.1109/ISI.2015.7165952 ↗
16. A DBN-based resampling SVM ensemble learning paradigm for credit classification with imbalanced data10.1016/j.asoc.2018.04.049 ↗
17. A Spammer Identification Method for Class Imbalanced Weibo Datasets10.1109/ACCESS.2019.2901756 ↗
18. Detecting spammers on social networks10.1016/j.neucom.2015.02.047 ↗
19. Deep neural networks for bot detection10.1016/j.ins.2018.08.019 ↗
20. WarningBird: A Near Real-Time Detection System for Suspicious URLs in Twitter Stream10.1109/TDSC.2013.3 ↗
21. DNA-Inspired Online Behavioral Modeling and Its Application to Spambot Detection10.1109/MIS.2016.29 ↗
22. Chavoshi, N., Hamooni, H., and Mueen, A. (2016). DeBot: Twitter Bot Detection via Warped Correlation. Proceedings of the 2016 IEEE 16th International Conference on Data Mining (ICDM), IEEE.10.1109/ICDM.2016.0096 ↗
23. LSSL-SSD: Social Spammer Detection with Laplacian Score and Semi-supervised Learning
24. SybilBelief: A Semi-Supervised Learning Approach for Structure-Based Sybil Detection10.1109/TIFS.2014.2316975 ↗
25. Semi-Supervised Clue Fusion for Spammer Detection in Sina Weibo10.1016/j.inffus.2017.11.002 ↗
26. Ensemble Methods in Machine Learning10.1007/3-540-45014-9_1 ↗
27. A Neural Network-Based Ensemble Approach for Spam Detection in Twitter10.1109/TCSS.2018.2878852 ↗
28. SMOTE: Synthetic Minority Over-sampling Technique10.1613/jair.953 ↗
29. Fuzzy-Based Information Decomposition for Incomplete and Imbalanced Data Learning10.1109/TFUZZ.2017.2754998 ↗
30. Liu, S., Zhang, J., Wang, Y., and Xiang, Y. (2016). Fuzzy-based feature and instance recovery. Proceedings of the Asian Conference on Intelligent Information and Database Systems. ACIIDS 2016, Springer.10.1007/978-3-662-49381-6_58 ↗
31. Learning from Imbalanced Data10.1109/TKDE.2008.239 ↗
32. Domingos, P. (1999). MetaCost: A general method for making classifiers cost-sensitive. Proceedings of the fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining- KDD ’99, ACM Press.10.1145/312129.312220 ↗
33. AdaCost: Misclassification Cost-sensitive Boosting
34. Karray, F., Campilho, A., and Cheriet, F. (2017). A Weight-Selection Strategy on Training Deep Neural Networks for Imbalanced Classification. Image Analysis and Recognition, Springer International Publishing.
35. Predicting Hospital Readmission via Cost-Sensitive Deep Learning10.1109/TCBB.2018.2827029 ↗
36. A Cost-Sensitive Deep Belief Network for Imbalanced Classification10.1109/TNNLS.2018.2832648 ↗
37. Cost-Sensitive Feature Selection by Optimizing F-Measures10.1109/TIP.2017.2781298 ↗
38. LIBSVM: A library for support vector machines
39. Shalev-Shwartz, S., and Ben-David, S. (2014). Understanding Machine Learning: From Theory to Algorithms, Cambridge University Press.10.1017/CBO9781107298019 ↗
40. John, G.H., and Langley, P. (1995). Estimating continuous distributions in Bayesian classifiers. Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann Publishers.
41. Instance-based learning algorithms10.1007/BF00153759 ↗
42. Random Forests10.1023/A:1010933404324 ↗
43. Wright, R.E. (1995). Logistic regression. Reading and Understanding Multivariate Statistics, American Psychological Association.
44. Stacked generalization10.1016/S0893-6080(05)80023-1 ↗
45. A novel SVM-kNN-PSO ensemble method for intrusion detection system10.1016/j.asoc.2015.10.011 ↗
46. Jiang, X., Pan, S., Long, G., Chang, J., Jiang, J., and Zhang, C. (2018). Cost-sensitive Hybrid Neural Networks for Heterogeneous and Imbalanced Data. Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), IEEE.10.1109/IJCNN.2018.8489420 ↗
47. Chen, C., Zhang, J., Chen, X., Xiang, Y., and Zhou, W. (2015). 6 million spam tweets: A large ground truth for timely Twitter spam detection. Proceedings of the 2015 IEEE International Conference on Communications (ICC), IEEE.10.1109/ICC.2015.7249453 ↗