journal article·2022-05-17Open access

One-Class LSTM Network for Anomalous Network Traffic Detection

Yanmiao Li, Yingying Xu, Yankun Cao, Jiangang Hou, Chun Wang, Wei Guo, Xin Li, Yang Xin, Zhi Liu, Lizhen Cui

Applied Sciences· Volume 12· Issue 10

Abstract

Artificial intelligence-assisted security is an important field of research in relation to information security. One of the most important tasks is to distinguish between normal and abnormal network traffic (such as malicious or sudden traffic). Traffic data are usually extremely unbalanced, and this seriously hinders the detection of outliers. Therefore, the identification of outliers in unbalanced datasets has become a key issue. To help solve this challenge, there is increasing interest in focusing on one-class classification methods that train models based on the samples of a single given class. In this paper, long short-term memory (LSTM) is introduced into one-class classification, and one-class LSTM (OC-LSTM) is proposed based on the traditional one-class support vector machine (OC-SVM). In contrast with other hybrid deep learning methods based on auto-encoders, the proposed method is an end-to-end training network that uses a loss function such as the OC-SVM optimization objective for model training. A comprehensive experiment on three large complex network traffic datasets showed that this method is superior to the traditional shallow method and the most advanced deep method. Furthermore, the proposed method can provide an effective reference for anomaly detection research in the field of network security, especially for the application of one-class classification.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Anomaly Detection Techniques and Applications · Network Security and Intrusion Detection · Internet Traffic Analysis and Secure E-voting

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Cyberspace Security, Beijing University of Posts and Telecommunications, Beijing 100876, China

School of Information Science and Engineering, Shandong University, Qingdao 266237, China

School of Software, Shandong University, Jinan 250101, China

School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China

Optical Advanced Research Center, Shandong University, Qingdao 266237, China

Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR), Shandong University, Jinan 250101, China

Funding

Major Fundamental Research of Natural Science Foundation of Shandong Province

References (34)

Show source-provided references
1. Outlier detection: A survey
2. Zhou, C.R., and Paffenroth, C. (2017, January 13–17). Anomaly detection with robust deep autoencoders. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada.10.1145/3097983.3098052 ↗
3. A one-class classification approach for bot detection on Twitter10.1016/j.cose.2020.101715 ↗
4. Learning deep features for one-class classification10.1109/TIP.2019.2917862 ↗
5. IoT data feature extraction and intrusion detection system for smart cities based on deep migration learning10.1016/j.ijinfomgt.2019.04.006 ↗
6. Estimating the support of a high-dimensional distribution10.1162/089976601750264965 ↗
7. Support vector data description10.1023/B:MACH.0000008084.60811.49 ↗
8. A Detailed Investigation and Analysis of Using Machine Learning Techniques for Intrusion Detection10.1109/COMST.2018.2847722 ↗
9. From Intrusion Detection to Attacker Attribution: A Comprehensive Survey of Unsupervised Methods10.1109/COMST.2018.2854724 ↗
10. Detection of Malicious Code Variants Based on Deep Learning10.1109/TII.2018.2822680 ↗
11. Robust detection for network intrusion of industrial IoT based on multi-CNN fusion10.1016/j.measurement.2019.107450 ↗
12. Chalapathy, R., and Chawla, S. (2019). Deep learning for anomaly detection: A survey. arXiv.10.1145/3394486.3406704 ↗
13. Deep learning approaches for anomaly-based intrusion detection systems: A survey, taxonomy, and open issues10.1016/j.knosys.2019.105124 ↗
14. One-class classification: Taxonomy of study and review of techniques10.1017/S026988891300043X ↗
15. Dynamic ensemble selection for multi-class classification with one-class classifiers10.1016/j.patcog.2018.05.015 ↗
16. Double Behavior Characteristics for One-Class Classification Anomaly Detection in Networked Control Systems10.1109/TIFS.2017.2730581 ↗
17. Chalapathy, R., Khoa, N.L.D., and Chawla, S. (2020, January 6–10). Robust Deep Learning Methods for Anomaly Detection. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Virtual Event, CA, USA.10.1145/3394486.3406704 ↗
18. Feature data processing: Making medical data fit deep neural networks10.1016/j.future.2020.02.034 ↗
19. A hybrid feature model and deep-learning-based bearing fault diagnosis10.3390/s17122876 ↗
20. High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning10.1016/j.patcog.2016.03.028 ↗
21. Chalapathy, R., Menon, A.K., and Chawla, S. (2018). Anomaly detection using one-class neural networks. arXiv.
22. Chalapathy, R., Menon, A.K., and Chawla, S. (2017, January 18–22). Robust, deep and inductive anomaly detection. Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases Springer, Skopje, Macedonia.10.1007/978-3-319-71249-9_3 ↗
23. Chen, J., Sathe, S., Aggarwal, C., and Turaga, D. (2017, January 27–29). Outlier detection with autoencoder ensembles. Proceedings of the 2017 SIAM International Conference on Data Mining, Houston, TX, USA.10.1137/1.9781611974973.11 ↗
24. Ruff, L., Vandermeulen, R., Goernitz, N., Deecke, L., Siddiqui, S.A., Binder, A., and Kloft, M. (2018, January 10–15). Deep one-class classification. Proceedings of the International Conference on Machine Learning, Vienna, Austria.
25. One-Class Convolutional Neural Network10.1109/LSP.2018.2889273 ↗
26. Schlachter, P., Liao, Y., and Yang, B. (2019). Deep one-class classification using intra-class splitting. arXiv.10.1109/DSW.2019.8755576 ↗
27. Liu, F.T., Ting, K.M., and Zhou, Z. (2008). Isolation Forest, IEEE.10.1109/ICDM.2008.17 ↗
28. On estimation of a probability density function and mode10.1214/aoms/1177704472 ↗
29. Masci, J., Meier, U., Cireşan, D., and Schmidhuber, J. (2011). Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction, Springer.10.1007/978-3-642-21735-7_7 ↗
30. Tavallaee, M., Bagheri, E., Lu, W., and Ghorbani, A.A. (2009). A Detailed Analysis of the KDD CUP 99 Data Set, IEEE.10.1109/CISDA.2009.5356528 ↗
31. Toward generating a new intrusion detection dataset and intrusion traffic characterization
32. Fontugne, R., Borgnat, P., Abry, P., and Fukuda, K. (2010). Mawilab: Combining diverse anomaly detectors for automated anomaly labeling and performance benchmarking. Proceedings of the 6th International Conference, Springer.10.1145/1921168.1921179 ↗
33. Kim, C., Sim, J., and Choi, J. (2019, January 25). Generating labeled flow data from MAWILab traces for network intrusion detection. Proceedings of the ACM Workshop on Systems and Network Telemetry and Analytics, Phoenix, AZ, USA.10.1145/3322798.3329251 ↗
34. Abadi, M. (2016). Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv.