journal article·2023-05-26Open access

Machine Learning-Based Adaptive Synthetic Sampling Technique for Intrusion Detection

Mohammed Zakariah, Salman A. AlQahtani, Mabrook S. Al-Rakhami

Applied Sciences· Volume 13· Issue 11

Abstract

Traditional firewalls and data encryption techniques can no longer match the demands of current IoT network security due to the rising amount and variety of network threats. In order to manage IoT network risks, intrusion detection solutions have been advised. Even though machine learning (ML) helps the widely used intrusion detection techniques currently in use, these algorithms struggle with low detection rates and the requirement for extensive feature engineering. The deep learning model for IoT network intrusion detection is a method for traffic anomaly detection that is suggested by this study. To extract the sequence properties of data flow through a CNN, it combines an attention mechanism with a Long Short Term Memory (LSTM) network. This method uses adaptive synthetic sampling (ADASYN) to increase the size of minority-class samples. The proposed models demonstrated acceptable precision and recall for each class when used for binary-class classification, proving their stability and capacity to identify all classes correctly. The MLP classifier’s accuracy, precision, recall, and F1 value were 87%, 89%, 87%, and 89%, respectively, with an AUC score of 0.88. Overall, the proposed models performed well. The attack and all-class models exhibited good AUCs and macro metrics, the same as the proposed MLP classifier, which had an F1 score of 83% and an AUC score of 0.94. Additionally, it trained the MLP classifier and integrated the ADAM optimizer and category cross-entropy loss function for all-class classification. With an AUC value of 94%, it possessed 84% accuracy, 87% precision, 84% recall, and an 83% F1 score. A further indication of the hybrid model’s ability to combine the benefits of both models to improve overall performance was that it regularly outperformed the MLP model. This model’s accuracy and F1 score are better than those of earlier comparable algorithms, according to experimental results using the publicly accessible benchmark dataset for network intrusion detection (NSL–KDD).
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Network Security and Intrusion Detection · Internet Traffic Analysis and Secure E-voting · Anomaly Detection Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science, College of Computer and Information Science, King Saud University, Riyadh 11495, Saudi Arabia

New Emerging Technologies and 5G Network and Beyond Research Chair, Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, P.O. Box 51178, Riyadh 11543, Saudi Arabia

Department of Information Systems, College of Computer and Information Sciences, King Saud University, P.O. Box 51178, Riyadh 11543, Saudi Arabia

Funding

Deputyship for Research & Innovation, Ministry of Education in Saudi Arabia

References (58)

Show source-provided references
1. Kim, J., Shin, N., Jo, S.Y., and Kim, S.H. (2017, January 13–16). Method of intrusion detection using deep neural network. Proceedings of the 2017 IEEE International Conference on Big Data and Smart Computing (BigComp), Jeju, Republic of Korea.
2. Millennials’ Mentality on School Bullying Through R Programming
3. Robust detection for network intrusion of industrial IoT based on multi-CNN fusion10.1016/j.measurement.2019.107450 ↗
4. A survey of intrusion detection systems in wireless sensor networks10.1109/SURV.2013.050113.00191 ↗
5. Liu, H., and Lang, B. (2019). Machine Learning and Deep Learning Methods for Intrusion Detection Systems: A Survey. Appl. Sci., 9.10.3390/app9204396 ↗
6. Artificial Intelligence (AI)-Empowered Intrusion Detection Architecture for the Internet of Vehicles10.1109/MWC.001.2000428 ↗
7. Towards secure intrusion detection systems using deep learning techniques: Comprehensive analysis and review10.1016/j.jnca.2021.103111 ↗
8. Carneiro, J., Oliveira, N., Sousa, N., Maia, E., and Praça, I. (2022). Distributed Computing and Artificial Intelligence, Volume 1: 18th International Conference 18 2022, Springer International Publishing.
9. An Enhanced Intrusion Detection System using Particle Swarm Optimization Feature Extraction Technique10.1016/j.procs.2021.10.052 ↗
10. Intrusion detection systems using classical machine learning techniques vs integrated unsupervised feature learning and deep neural network10.1002/itl2.232 ↗
11. A Deep Learning-Based Framework for Feature Extraction and Classification of Intrusion Detection in Networks10.1155/2022/2215852 ↗
12. Fu, Y., Du, Y., Cao, Z., Li, Q., and Xiang, W. (2022). A Deep Learning Model for Network Intrusion Detection with Imbalanced Data. Electronics, 11.10.3390/electronics11060898 ↗
13. Musa, U.S., Chhabra, M., Ali, A., and Kaur, M. (2020, January 10–12). Intrusion detection system using machine learning techniques: A review. Proceedings of the 2020 International Conference on Smart Electronics and Communication (ICOSEC), Trichy, India.10.1109/ICOSEC49089.2020.9215333 ↗
14. A multi-level intrusion detection method based on KNN outlier detection and random forests
15. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-Excitation Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
16. A Double-Layered Hybrid Approach for Network Intrusion Detection System Using Combined Naive Bayes and SVM10.1109/ACCESS.2021.3118573 ↗
17. A novel statistical analysis and autoencoder driven intelligent intrusion detection approach10.1016/j.neucom.2019.11.016 ↗
18. Ding, Y., and Zhai, Y. (2018, January 8–10). Intrusion detection system for NSL-KDD dataset using convolutional neural networks. Proceedings of the 2018 2nd International Conference on Computer Science and Artificial Intelligence, Shenzhen, China.10.1145/3297156.3297230 ↗
19. An adaptive ensemble machine learning model for intrusion detection10.1109/ACCESS.2019.2923640 ↗
20. Network intrusion detection combined hybrid sampling with deep hierarchical network10.1109/ACCESS.2020.2973730 ↗
21. Cybersecurity for higher education institutions: Adopting regulatory framework10.30574/gjeta.2020.2.3.0013 ↗
22. Berman, D.S., Buczak, A.L., Chavis, J.S., and Corbett, C.L. (2019). A Survey of Deep Learning Methods for Cyber Security. Information, 10.10.3390/info10040122 ↗
23. Understanding Security Requirements and Challenges in Internet of Things (IoT): A Re-view
24. Modelling cyber-attacks: A survey study10.1016/S1353-4858(18)30025-4 ↗
25. Hindy, H., Tachtatzis, C., Atkinson, R., Bayne, E., and Bellekens, X. (2020). MQTT-IoT-IDS 2020: MQTT internet of things intrusion detection dataset. IEEE Dataport.
26. Hindy, H., Tachtatzis, C., Atkinson, R., Bayne, E., and Bellekens, X. (2021, January 26). Developing a siamese network for intrusion detection systems. Proceedings of the 1st Workshop on Machine Learning and Systems, ser. EuroMLSys’21, Online, UK.10.1145/3437984.3458842 ↗
27. Hindy, H., Tachtatzis, C., Atkinson, R., Brosset, D., Bures, M., Andonovic, I., Michie, C., and Bellekens, X. (2020). Leveraging Siamese networks for One-Shot intrusion detection model. arXiv.
28. Hindy, H., Atkinson, R., Tachtatzis, C., Colin, J.-N., Bayne, E., and Bellekens, X. (2020). Utilising Deep Learning Techniques for Effective Zero-Day Attack Detection. Electronics, 9.10.3390/electronics9101684 ↗
29. Survey of intrusion detection systems: Techniques, datasets and challenges10.1186/s42400-019-0038-7 ↗
30. An Intrusion Detection Model with Hierarchical Attention Mechanism10.1109/ACCESS.2020.2983568 ↗
31. Implementation of adaptive scheme in evolutionary technique for anomaly-based intrusion detection10.1007/s12065-019-00293-8 ↗
32. BAT: Deep Learning Methods on Network Intrusion Detection Using NSL-KDD Dataset10.1109/ACCESS.2020.2972627 ↗
33. Comparing the Area of Data Mining Algorithms in Network Intrusion Detection
34. A NSGA2-LR wrapper approach for feature selection in network intrusion detection10.1016/j.comnet.2020.107183 ↗
35. An efficient intrusion detection technique based on support vector machine and improved binary gravitational search algorithm10.1007/s10462-019-09762-z ↗
36. Dey, S.K., and Rahman, M.M. (2020). Effects of Machine Learning Approach in Flow-Based Anomaly Detection on Software-Defined Networking. Symmetry, 12.10.3390/sym12010007 ↗
37. Evolving deep learning architectures for network intrusion detection using a double PSO metaheuristic10.1016/j.comnet.2019.107042 ↗
38. Iwendi, C., Khan, S., Anajemba, J.H., Mittal, M., Alenezi, M., and Alazab, M. (2020). The Use of Ensemble Models for Multiple Class and Binary Class Classification for Improving Intrusion Detection Systems. Sensors, 20.10.3390/s20092559 ↗
39. An improved ensemble approach for effective intrusion detection10.1007/s11227-019-03035-w ↗
40. Ashiku, L., and Dagli, C. (2019, January 19–22). Cybersecurity as a Centralized Directed System of Systems using SoS Explorer as a Tool. Proceedings of the 2019 14th Annual Conference System of Systems Engineering (SoSE), Anchorage, AK, USA.10.1109/SYSOSE.2019.8753872 ↗
41. Latif, S., Zeba, I., Zhuo, Z., and Jawad, A. (2020, January 20–21). DRaNN: A Deep Random Neural Network Model for Intrusion Detection in Industrial IoT. Proceedings of the 2020 International Conference on UK-China Emerging Technologies (UCET), Glasgow, UK.10.1109/UCET51115.2020.9205361 ↗
42. A deep learning method with wrapper based feature extraction for wireless intrusion detection system10.1016/j.cose.2020.101752 ↗
43. Supratik, P., Kurin, V., and Whiteson, S. (2019). Fast efficient hyperparameter tuning for policy gradients. arXiv.
44. Zhang, H., Wu, C.Q., Gao, S., Wang, Z., Xu, Y., and Liu, Y. (2018, January 20–24). An Effective Deep Learning Based Scheme for Network Intrusion Detection. Proceedings of the 2018 24th International Conference on Pattern Recognition (ICPR), Beijing, China.10.1109/ICPR.2018.8546162 ↗
45. Deep Learning for Intrusion Detection and Security of Internet of Things (IoT): Current Analysis, Challenges, and Possible Solutions10.1155/2022/4016073 ↗
46. RDH-based dynamic weighted histogram equalization using for secure transmission and cancer prediction10.1007/s00530-020-00718-w ↗
47. Ali, M.H., Jaber, M.M., Abd, S.K., Rehman, A., Awan, M.J., Damaševičius, R., and Bahaj, S.A. (2022). Threat Analysis and Distributed Denial of Service (DDoS) Attack Recognition in the Internet of Things (IoT). Electronics, 11.10.3390/electronics11030494 ↗
48. Towards Enhancing the Capability of IoT Applications by Utilizing Cloud Computing Concept10.1155/2022/2335313 ↗
49. Tavallaee, M., Bagheri, E., Lu, W., and Ghorbani, A. (2009, January 8–10). A Detailed Analysis of the KDD CUP 99 Data Set. Proceedings of the Submitted to Second IEEE Symposium on Computational Intelligence for Security and Defense Applications (CISDA), Ottawa, ON, Canada.10.1109/CISDA.2009.5356528 ↗
50. SMOTE: Synthetic Minority Over-sampling Technique10.1613/jair.953 ↗
51. He, H., Bai, Y., Garcia, E.A., and Li, S. (2008, January 1–8). ADASYN: Adaptive synthetic sampling approach for imbalanced learning. Proceedings of the 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), Hong Kong, China.
52. Visualizing High-Dimensional Data. Using t-SNE
53. A Deep Learning Method with Filter Based Feature Engineering for Wireless Intrusion Detection System10.1109/ACCESS.2019.2905633 ↗
54. Chen, T., He, T., Benesty, M., Khotilovich, V., Tang, Y., Cho, H., Chen, K., Mitchell, R., Cano, I., and Zhou, T. (2023, May 21). Xgboost: Extreme gradient boosting. Available online: https://cran.microsoft.com/snapshot/2017-12-11/web/packages/xgboost/vignettes/xgboost.pdf.
55. Interpretable Stroke Risk Prediction Using Machine Learning Algorithms10.1007/978-981-19-7663-6_61 ↗
56. Mavrogiorgou, A., Kiourtis, A., Kleftakis, S., Mavrogiorgos, K., Zafeiropoulos, N., and Kyriazis, D. (2022). A Catalogue of Machine Learning Algorithms for Healthcare Risk Predictions. Sensors, 22.10.3390/s22228615 ↗
57. A survey on intrusion detection system: Feature selection, model, performance measures, application perspective, challenges, and future research directions10.1007/s10462-021-10037-9 ↗
58. Zhang, C., Ruan, F., Yin, L., Chen, X., Zhai, L., and Liu, F. (2019, January 25–27). A Deep Learning Approach for Network Intrusion Detection Based on NSL-KDD Dataset. Proceedings of the 2019 IEEE 13th International Conference on Anti-counterfeiting Security, and Identification (ASID), Xiamen, China.10.1109/ICASID.2019.8925239 ↗