journal article·2025-02-07Open access

Adaptive Semi-Supervised Algorithm for Intrusion Detection and Unknown Attack Identification

Meng Li, Lei Luo, Kun Xiao, Geng Wang, Yintao Wang

Applied Sciences· Volume 15· Issue 4

Abstract

Intrusion detection systems face significant challenges, including the inability to detect unknown threats and imbalances between normal and anomalous traffic. To address these limitations, we propose a semi-supervised intrusion detection algorithm based on GAN with a Transformer backbone for network security in IoT devices. To address the issue of imbalanced normal and anomalous traffic due to the diversity of network behavior and the difficulty that supervised algorithms experience in detecting unknown intrusions, we use only normal traffic as training data. By integrating the self-attention mechanism of Transformers, we leverage their ability to capture long-range dependencies in sequential data, enhancing the core capability of the GAN. The experimental results show that our algorithm achieves an F1-score of 95.2% and a false omission rate (FOR) of 10.7% on the CIC-IDS2017 dataset. On the Kitsune dataset, it attains an F1-score of 83.2% and a FOR of 15.8%. In real-world applications, when the algorithm was deployed on actual vehicle devices, it maintained strong performance with a FOR of 13%, further validating the practical applicability and value of the algorithm.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Network Security and Intrusion Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information and Software Engineering, Shahe Campus, University of Electronic Science and Technology of China, Chengdu 610054, China

References (32)

Show source-provided references
1. Bitdefender (2024, August 26). The 2024 IoT Security Landscape Report. Available online: Https://www.bitdefender.com.
2. Díaz-Verdejo, J., Muñoz-Calle, J., Estepa Alonso, A., Estepa Alonso, R., and Madinabeitia, G. (2022). On the detection capabilities of signature-based intrusion detection systems in the context of web attacks. Appl. Sci., 12.10.3390/app12020852 ↗
3. Zero-day attack detection: A systematic literature review10.1007/s10462-023-10437-z ↗
4. Benchmarking of machine learning for anomaly based intrusion detection systems in the CICIDS2017 dataset10.1109/ACCESS.2021.3056614 ↗
5. Hao, Y., Dong, L., Wei, F., Xu, K., and Zhang, S. (2021, January 2–9). Self-attention attribution: Interpreting information interactions inside transformer. Proceedings of the AAAI Conference on Artificial Intelligence, Virtually.10.1609/aaai.v35i14.17533 ↗
6. Remora based Deep Maxout Network model for network intrusion detection using Convolutional Neural Network features10.1016/j.compeleceng.2023.108831 ↗
7. A deep learning technique for intrusion detection system using a Recurrent Neural Networks based framework10.1016/j.comcom.2022.12.010 ↗
8. A Comparative study of intrusion detection systems applied to NSL-KDD Dataset
9. Analysis of intrusion detection systems in UNSW-NB15 and NSL-KDD datasets with machine learning algorithms10.17798/bitlisfen.1240469 ↗
10. GAN-based imbalanced data intrusion detection system10.1007/s00779-019-01332-y ↗
11. Thanh-Tung, H., and Tran, T. (2020, January 19–24). Catastrophic forgetting and mode collapse in GANs. Proceedings of the 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, UK.10.1109/IJCNN48605.2020.9207181 ↗
12. SCA-GANomaly: An unsupervised anomaly detection model of high-speed railway catenary components10.1007/s11042-024-19011-3 ↗
13. Zhang, C., Cai, Y., Lin, G., and Shen, C. (2020, January 13–19). Deepemd: Few-shot image classification with differentiable earth mover’s distance and structured classifiers. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01222 ↗
14. Singh, A., and Jang-Jaccard, J. (2022). Autoencoder-based unsupervised intrusion detection using multi-scale convolutional recurrent networks. arXiv.
15. Unsupervised deep learning approach for in-vehicle intrusion detection system10.1109/MCE.2021.3116923 ↗
16. A Survey on the Applications of Semi-supervised Learning to Cyber-security10.1145/3657647 ↗
17. XA-GANomaly: An explainable adaptive semi-supervised learning method for intrusion detection using GANomaly
18. Unsupervised intrusion detection system for in-vehicle communication networks
19. Krasnov, D., Davis, D., Malott, K., and Chen, Y. (2023). Fuzzy c-means clustering: A review of applications in breast cancer detection. Entropy, 25.10.3390/e25071021 ↗
20. A fuzzy C-means algorithm for optimizing data clustering10.1016/j.eswa.2023.120377 ↗
21. Rosay, A., Cheval, E., Carlier, F., and Leroux, P. (2022, January 9–11). Network intrusion detection: A comprehensive analysis of CIC-IDS2017. Proceedings of the 8th International Conference on Information Systems Security and Privacy, Online.10.5220/0010774000003120 ↗
22. An innovative approach for integrating two-dimensional conversion of Vis-NIR spectra with the Swin Transformer model to leverage deep learning for predicting soil properties10.1016/j.geoderma.2023.116555 ↗
23. ValizadehAslani, T., and Liang, H. (2024). LayerNorm: A key component in parameter-efficient fine-tuning. arXiv.
24. Solution of physics-based inverse problems using conditional generative adversarial networks with full gradient penalty10.1016/j.cma.2023.116338 ↗
25. Comparing two SVM models through different metrics based on the confusion matrix10.1016/j.cor.2022.106131 ↗
26. DI-NIDS: Domain invariant network intrusion detection system10.1016/j.knosys.2023.110626 ↗
27. Network Intrusion Detection Method Based on Multi-Scale CNN in Internet of Things
28. Aktar, S. (2022). Network Intrusion Detection Using a Deep Learning Approach. [Master’s Thesis, The University of New Orleans].
29. Aldhaheri, S., and Alhuzali, A. (2023). SGAN-IDS: Self-attention-based generative adversarial network against intrusion detection systems. Sensors, 23.10.3390/s23187796 ↗
30. Kaliyaperumal, P., Periyasamy, S., Thirumalaisamy, M., and Balamurugan, B. (2024). A Novel Hybrid Unsupervised Learning Approach for Enhanced Cybersecurity in the IoT. Future Internet, 16.10.3390/fi16070253 ↗
31. Ma, X., Luo, L., and Zeng, Q. (2024, January 14–16). From One Thousand Pages of Specification to Unveiling Hidden Bugs: Large Language Model Assisted Fuzzing of Matter IoT Devices. Proceedings of the 33rd USENIX Security Symposium (USENIX Security 24), Philadelphia, PA, USA.
32. Feng, X., Sun, R., Zhu, X., Xue, M., Wen, S., Liu, D., Nepal, S., and Xiang, Y. (2021, January 15–19). Snipuzz: Black-box fuzzing of IoT firmware via message snippet inference. Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security, Virtual Event.10.1145/3460120.3484543 ↗