Adversarial Robust and Explainable Network Intrusion Detection Systems Based on Deep Learning
Source abstract
Abstract
The ever-evolving cybersecurity environment has given rise to sophisticated adversaries who constantly explore new ways to attack cyberinfrastructure. Recently, the use of deep learning-based intrusion detection systems has been on the rise. This rise is due to deep neural networks (DNN) complexity and efficiency in making anomaly detection activities more accurate. However, the complexity of these models makes them black-box models, as they lack explainability and interpretability. Not only is the DNN perceived as a black-box model, but recent research evidence has also shown that they are vulnerable to adversarial attacks. This paper developed an adversarial robust and explainable network intrusion detection system based on deep learning by applying adversarial training and implementing explainable AI techniques. In our experiments with the NSL-KDD dataset, the PGD adversarial-trained model was a more robust model than DeepFool adversarial-trained and FGSM adversarial-trained models, with a ROC-AUC of 0.87. The FGSM attack did not affect the PGD adversarial-trained model’s ROC-AUC, while the DeepFool attack caused a minimal 9.20% reduction in PGD adversarial-trained model’s ROC-AUC. PGD attack caused a 15.12% reduction in the DeepFool adversarial-trained model’s ROC-AUC and a 12.79% reduction in FGSM trained model’s ROC-AUC.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Adversarial Robustness in Machine Learning · Network Security and Intrusion Detection · Advanced Malware Detection Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computing, Gachon University, Seongnam-si 13120, Korea
Funding
National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT)
References (40)
Show source-provided references
1. Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., and Fergus, R. (2013). Intriguing properties of neural networks. arXiv.
2. Goodfellow, I.J., Shlens, J., and Szegedy, C. (2014). Explaining and harnessing adversarial examples. arXiv.
3. Madry, A., Makelov, A., Schmidt, L., Tsipras, D., and Vladu, A. (2018). Towards Deep Learning Models Resistant to Adversarial Attacks. arXiv.
4. Papernot, N., McDaniel, P.D., Jha, S., Fredrikson, M., Celik, Z.B., and Swami, A. (2016, January 21–24). The limitations of deep learning in adversarial settings. Proceedings of the IEEE European Symposium on Security and Privacy (EuroS&P’16), Saarbrücken, Germany.10.1109/EuroSP.2016.36 ↗
5. Moosavi-Dezfooli, S.-M., Fawzi, A., and Frossard, P. (2015). DeepFool: A simple and accurate method to fool deep neural networks. arXiv.10.1109/CVPR.2016.282 ↗
6. Carlini, N., and Wagner, D. (2017, January 22–26). Towards Evaluating the Robustness of Neural Networks. Proceedings of the 2017 IEEE Symposium on Security and Privacy (SP), San Jose, CA, USA.10.1109/SP.2017.49 ↗
7. Evaluating and Improving Adversarial Robustness of Machine Learning-Based Network Intrusion Detectors10.1109/JSAC.2021.3087242 ↗
8. Rigaki, M. (2017). Adversarial Deep Learning against Intrusion Detection Classifiers. [Master’s Thesis, Lulea University of Technology].
9. Deep Learning-Based Intrusion Detection with Adversaries10.1109/ACCESS.2018.2854599 ↗
10. Hashemi, M., and Keller, E. (2020, January 10–12). Enhancing Robustness against Adversarial Examples in Network Intrusion Detection Systems. Proceedings of the 2020 IEEE Conference on Network Function Virtualization and Software Defined Networks (NFV-SDN), Leganes, Spain.10.1109/NFV-SDN50289.2020.9289869 ↗
11. Sarhan, M., Layeghy, S., and Portmann, M. (2021). An Explainable Machine Learning-based Network Intrusion Detection System for Enabling Generalisability in Securing IoT Networks. arXiv.10.21203/rs.3.rs-2035633/v1 ↗
12. Du, M., Liu, N., and Hu, X. (2018). Techniques for interpretable machine learning. arXiv.
13. Rigaki, M. (2017, January 18–20). Adversarial deep learning against intrusion detection classifiers. Proceedings of the NATO IST-152 Workshop on Intelligent Autonomous Agents for Cyber Defence and Resilience, IST-152 2017, Prague, Czech Republic.
14. Adversarial Attacks and Defenses in Images, Graphs and Text: A Review10.1007/s11633-019-1211-x ↗
15. Adversarial Attacks and Defenses in Deep Learning10.1016/j.eng.2019.12.012 ↗
16. Hinton, G.E., Vinyals, O., and Dean, J. (2015). Distilling the Knowledge in a Neural Network. arXiv.
17. Buckman, J., Roy, A., Raffel, C., and Goodfellow, I. (May, January 30). Thermometer encoding: One hot way to resist adversarial examples. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada.
18. Dhillon, G.S., Azizzadenesheli, K., Lipton, Z.C., Bernstein, J., Kossaifi, J., Khanna, A., and Anandkumar, A. (2018). Stochastic Activation Pruning for Robust Adversarial Defense. arXiv.
19. Debicha, I., Debatty, T., Dricot, J., and Mees, W. (2021). Adversarial Training for Deep Learning-based Intrusion Detection Systems. arXiv.
20. Aiken, J., and Scott-Hayward, S. (2019, January 12–14). Investigating Adversarial Attacks against Network Intrusion Detection Systems in SDNs. Proceedings of the 2019 IEEE Conference on Network Function Virtualization and Software Defined Networks (NFV-SDN), Dallas, TX, USA.10.1109/NFV-SDN47374.2019.9040101 ↗
21. Nicolae, M., Sinn, M., Tran, M., Buesser, B., Rawat, A., Wistuba, M., Zantedeschi, V., Baracaldo, N., Chen, B., and Ludwig, H. (2018). Adversarial Robustness Toolbox v1.0.0. arXiv.
22. A Review of the Advancement in Intrusion Detection Datasets10.1016/j.procs.2020.03.330 ↗
23. Canadian Institute for Cybersecurity (2021, September 13). (n.d.-b). NSL-KDD. UNB. Available online: https://www.unb.ca/cic/datasets/nsl.html.
24. Hettich, S., and Bay, S.D. (1999). The UCI KDD Archive, University of California, Department of Information and Computer Science. Available online: http://kdd.ics.uci.edu.
25. Khamis, R.A., and Matrawy, A. (2020, January 20–22). Evaluation of Adversarial Training on Different Types of Neural Networks in Deep Learning-based IDSs. Proceedings of the 2020 International Symposium on Networks, Computers and Communications (ISNCC), Montreal, QC, Canada.10.1109/ISNCC49221.2020.9297344 ↗
26. A semi-supervised deep auto-encoder based intrusion detection for IoT10.18280/isi.250503 ↗
27. Mane, S., and Rao, D. (2021). Explaining Network Intrusion Detection System Using Explainable AI Framework. arXiv.
28. Yang, K., Liu, J., Zhang, C., and Fang, Y. (2018, January 29–31). Adversarial Examples against the Deep Learning Based Network Intrusion Detection Systems. Proceedings of the MILCOM 2018—2018 IEEE Military Communications Conference (MILCOM), Los Angeles, CA, USA.10.1109/MILCOM.2018.8599759 ↗
29. Tishby, N., and Zaslavsky, N. (May, January 26). Deep learning and the information bottleneck principle. Proceedings of the 2015 IEEE Information Theory Workshop (ITW), Jerusalem, Israel.10.1109/ITW.2015.7133169 ↗
30. An Explainable Machine Learning Framework for Intrusion Detection Systems10.1109/ACCESS.2020.2988359 ↗
31. Liu, H., and Lang, B. (2019). Machine Learning and Deep Learning Methods for Intrusion Detection Systems: A Survey. Appl. Sci., 9.10.3390/app9204396 ↗
32. (2022, January 15). Classification: ROC Curve and AUC|Machine Learning Crash Course|. Available online: https://developers.google.com/machine-learning/crash-course/classification/roc-and-auc#:%7E:text=An%20ROC%20curve%20(receiver%20operating,False%20Positive%20Rate.
33. Prequential AUC: Properties of the area under the ROC curve for data streams with concept drift10.1007/s10115-017-1022-8 ↗
34. Reddy, S.K. (2022, March 24). AUC ROC Score and Curve in Multi-Class Classification Problems: InBlog. Ineuron. Available online: https://blog.ineuron.ai/AUC-ROC-score-and-curve-in-multiclass-classification-problems-2ja4jOHb2X.
35. Using AUC and accuracy in evaluating learning algorithms10.1109/TKDE.2005.50 ↗
36. Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative Adversarial Networks. arXiv.
37. Learning to Compose Domain-Specific Transformations for Data Augmentation
38. From Intrusion Detection to Attacker Attribution: A Comprehensive Survey of Unsupervised Methods10.1109/COMST.2018.2854724 ↗
39. Kurakin, A., Goodfellow, I.J., and Bengio, S. (2017). Adversarial Machine Learning at Scale. arXiv.
40. Athalye, A., Carlini, N., and Wagner, D.A. (2018). Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examples. arXiv.