Overview on Intrusion Detection Systems Design Exploiting Machine Learning for Networking Cybersecurity
Source abstract
Abstract
The Intrusion Detection System (IDS) is an effective tool utilized in cybersecurity systems to detect and identify intrusion attacks. With the increasing volume of data generation, the possibility of various forms of intrusion attacks also increases. Feature selection is crucial and often necessary to enhance performance. The structure of the dataset can impact the efficiency of the machine learning model. Furthermore, data imbalance can pose a problem, but sampling approaches can help mitigate it. This research aims to explore machine learning (ML) approaches for IDS, specifically focusing on datasets, machine algorithms, and metrics. Three datasets were utilized in this study: KDD 99, UNSW-NB15, and CSE-CIC-IDS 2018. Various machine learning algorithms were chosen and examined to assess IDS performance. The primary objective was to provide a taxonomy for interconnected intrusion detection systems and supervised machine learning algorithms. The selection of datasets is crucial to ensure the suitability of the model construction for IDS usage. The evaluation was conducted for both binary and multi-class classification to ensure the consistency of the selected ML algorithms for the given dataset. The experimental results demonstrated accuracy rates of 100% for binary classification and 99.4In conclusion, it can be stated that supervised machine learning algorithms exhibit high and promising classification performance based on the study of three popular datasets.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Network Security and Intrusion Detection · Advanced Malware Detection Techniques · Anomaly Detection Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Information Engineering, University of Pisa, 56126 Pisa, Italy
School of Intelligence Engineering, Shandong Management University, Jinan 250100, China
Department of the Computer Science, University of Tunis, Tunis 1007, Tunisia
Funding
Horizon Europe program · European High-Performance Computing Joint Undertaking (JU) program
References (82)
Show source-provided references
1. Musa, U.S., Chhabra, M., Ali, A., and Kaur, M. (2020, January 10–12). Intrusion Detection System using Machine Learning Techniques: A Review. Proceedings of the 2020 International Conference on Smart Electronics and Communication (ICOSEC), Trichy, India.10.1109/ICOSEC49089.2020.9215333 ↗
2. Detecting malicious URLs using machine learning techniques: Review and research directions10.1109/ACCESS.2022.3222307 ↗
3. Okey, O.D., Maidin, S.S., Adasme, P., Lopes Rosa, R., Saadi, M., Carrillo Melgarejo, D., and Zegarra Rodríguez, D. (2022). BoostedEnML: Efficient technique for detecting cyberattacks in IoT systems using boosted ensemble machine learning. Sensors, 22.10.3390/s22197409 ↗
4. Survey of feature selection and extraction techniques for stock market prediction10.1186/s40854-022-00441-7 ↗
5. Bhuyan, M.H., Bhattacharyya, D.K., and Kalita, J.K. (2017). Network Traffic Anomaly Detection and Prevention: Concepts, Techniques, and Tools, Springer.10.1007/978-3-319-65188-0 ↗
6. Event-based security tracking control for networked control systems against stochastic cyber-attacks10.1016/j.ins.2022.08.085 ↗
7. Dynamic event-triggered output feedback control for networked systems subject to multiple cyber attacks10.1109/TCYB.2021.3125851 ↗
8. Qu, F., Tian, E., and Zhao, X. (2022). Chance-Constrained H-infinity State Estimation for Recursive Neural Networks Under Deception Attacks and Energy Constraints: The Finite-Horizon Case. IEEE Trans. Neural Netw. Learn. Syst.10.1109/TNNLS.2021.3137426 ↗
9. Data-driven fault diagnosis for traction systems in high-speed trains: A survey, challenges, and perspectives10.1109/TITS.2020.3029946 ↗
10. Deep learning techniques to identify and classify COVID-19 abnormalities on chest X-ray images
11. Fine-grained modulation classification using multi-scale radio transformer with dual-channel representation10.1109/LCOMM.2022.3145647 ↗
12. Elhanashi, A., Gasmi, K., Begni, A., Dini, P., Zheng, Q., and Saponara, S. (2023). Applications in Electronics Pervading Industry, Environment and Society: APPLEPIES 2022, Springer.
13. Pisner, D.A., and Schnyer, D.M. (2020). Machine Learning, Elsevier.
14. Support vector machine in machine condition monitoring and fault diagnosis10.1016/j.ymssp.2006.12.007 ↗
15. Pervez, M.S., and Farid, D.M. (2014, January 18–20). Feature selection and intrusion classification in NSL-KDD cup 99 dataset employing SVMs. Proceedings of the 8th International Conference on Software, Knowledge, Information Management and Applications (SKIMA 2014), Dhaka, Bangladesh.10.1109/SKIMA.2014.7083539 ↗
16. On the KDD’99 dataset: Support vector machine based intrusion detection system (ids) with different kernels
17. Jing, D., and Chen, H.B. (November, January 29). SVM based network intrusion detection for the UNSW-NB15 dataset. Proceedings of the 2019 IEEE 13th international conference on ASIC (ASICON), Chongqing, China.10.1109/ASICON47005.2019.8983598 ↗
18. Performance analysis of intrusion detection systems using a feature selection method on the UNSW-NB15 dataset10.1186/s40537-020-00379-6 ↗
19. Calibration of various optimized machine learning classifiers in network intrusion detection system on the realistic cyber dataset CSE-CIC-IDS2018 using cloud computing
20. Intrusion detection of imbalanced network traffic based on machine learning and deep learning10.1109/ACCESS.2020.3048198 ↗
21. Raj, A. (2023, January 30). An Exhaustive Guide to Decision Tree Classification in Python 3.x. Available online: https://towardsdatascience.com/an-exhaustive-guide-to-classification-using-decision-trees-8d472e77223f.
22. A Survey on Decision Tree Algorithm for Classification
23. Lee, J.H., Lee, J.H., Sohn, S.G., Ryu, J.H., and Chung, T.M. (2008, January 17–20). Effective value of decision tree with KDD 99 intrusion detection datasets for intrusion detection system. Proceedings of the 2008 10th International Conference on Advanced Communication Technology, Gangwon, Republic of Korea.10.1109/ICACT.2008.4493974 ↗
24. Amor, N.B., Benferhat, S., and Elouedi, Z. (2004, January 14–17). Naive bayes vs decision trees in intrusion detection systems. Proceedings of the 2004 ACM Symposium on Applied Computing, Nicosia, Cyprus.10.1145/967900.967989 ↗
25. Using machine learning techniques to identify rare cyber-attacks on the UNSW-NB15 dataset10.1002/spy2.91 ↗
26. Detecting web attacks using random undersampling and ensemble learners10.1186/s40537-021-00460-8 ↗
27. Education, I.C. (2023, January 30). Random Forest. Available online: https://www.ibm.com/cloud/learn/random-forest.
28. Feature Selection for Intrusion Detection Using Random Forest
29. Support Vector Machine and Random Forest Modeling for Intrusion Detection System (IDS)
30. Hassine, K., Erbad, A., and Hamila, R. (2019, January 24–28). Important complexity reduction of random forest in multi-classification problem. Proceedings of the 2019 15th International Wireless Communications & Mobile Computing Conference (IWCMC), Tangier, Morocco.10.1109/IWCMC.2019.8766544 ↗
31. Primartha, R., and Tama, B.A. (2017, January 1–2). Anomaly detection using random forest: A performance revisited. Proceedings of the 2017 International Conference on Data and Software Engineering (ICoDSE), Palembang, Indonesia.10.1109/ICODSE.2017.8285847 ↗
32. Mishra, S., and Datta-Gupta, A. (2018). Applied Statistical Modeling and Data Analytics, Elsevier.
33. Worsfold, P., Townshend, A., and Poole, C. (2005). Encyclopedia of Analytical Science, Elsevier. [2nd ed.].
34. Discriminant analysis based feature selection in kdd intrusion dataset
35. Network intrusion detection: Evaluating cluster, discriminant, and logit analysis10.1016/j.ins.2007.02.034 ↗
36. Solani, S., and Jadav, N.K. (2021). Inventive Communication and Computational Technologies, Springer.
37. Increasing the performance of machine learning-based IDSs on an imbalanced and up-to-date dataset10.1109/ACCESS.2020.2973219 ↗
38. Benaddi, H., Ibrahimi, K., and Benslimane, A. (2018, January 16–19). Improving the Intrusion Detection System for NSL-KDD Dataset based on PCA-Fuzzy Clustering-KNN. Proceedings of the 2018 6th International Conference on Wireless Networks and Mobile Communications (WINCOM), Marrakesh, Morocco.10.1109/WINCOM.2018.8629718 ↗
39. Kuang, L., and Zulkernine, M. (2008, January 16–20). An anomaly intrusion detection method using the CSI-KNN algorithm. Proceedings of the 2008 ACM Symposium on Applied Computing, Ceara, Brazil.10.1145/1363686.1363897 ↗
40. Performance Analysis of Machine Learning Classifiers for Intrusion Detection Using Unsw-Nb15 Dataset10.5121/csit.2020.102004 ↗
41. Dini, P., and Saponara, S. (2021). Analysis, design, and comparison of machine-learning techniques for networking intrusion detection. Designs, 5.10.3390/designs5010009 ↗
42. A survey and analysis of intrusion detection models based on cse-cic-ids2018 big data10.1186/s40537-020-00382-x ↗
43. Deep learning in neural networks: An overview10.1016/j.neunet.2014.09.003 ↗
44. Al-Janabi, S.T.F., and Saeed, H.A. (2011, January 6–8). A Neural Network Based Anomaly Intrusion Detection System. Proceedings of the 2011 Developments in E-Systems Engineering, Dubai, United Arab Emirates.10.1109/DeSE.2011.19 ↗
45. Network intrusion detection algorithm based on deep neural network10.1049/iet-ifs.2018.5258 ↗
46. Hanif, S., Ilyas, T., and Zeeshan, M. (2019, January 6–9). Intrusion Detection In IoT Using Artificial Neural Networks On UNSW-15 Dataset. Proceedings of the 2019 IEEE 16th International Conference on Smart Cities: Improving Quality of Life Using ICT IoT and AI (HONET-ICT), Charlotte, NC, USA.10.1109/HONET.2019.8908122 ↗
47. Rajagopal, S., Hareesha, K.S., and Kundapur, P.P. (2020). Advanced Computing and Intelligent Engineering, Springer.
48. An intrusion detection model based on a convolutional neural network10.33851/JMIS.2019.6.4.165 ↗
49. Kanimozhi, V., and Jacob, T.P. (2019, January 4–6). Artificial Intelligence based Network Intrusion Detection with Hyper-Parameter Optimization Tuning on the Realistic Cyber Dataset CSE-CIC-IDS2018 using Cloud Computing. Proceedings of the 2019 International Conference on Communication and Signal Processing (ICCSP), Chennai, India.10.1109/ICCSP.2019.8698029 ↗
50. Moustafa, N., and Slay, J. (2015, January 10–12). UNSW-NB15: A comprehensive data set for network intrusion detection systems (UNSW-NB15 network data set). Proceedings of the 2015 Military Communications and Information Systems Conference (MilCIS), Canberra, ACT, Australia.10.1109/MilCIS.2015.7348942 ↗
51. University of New Brunswick, Canadian Institute for Cybersecurity (2023, January 30). CSE-CIC-IDS2018 on AWS. Available online: https://www.unb.ca/cic/datasets/ids-2018.html.
52. Grandini, M., Bagli, E., and Visani, G. (2020). Metrics for multi-class classification: An overview. arXiv.
53. Design and Testing Novel One-Class Classifier Based on Polynomial Interpolation With Application to Networking Security10.1109/ACCESS.2022.3186026 ↗
54. Scikit-Learn Developers (2023, January 30). Metrics and Scoring: Quantifying the Quality of Predictions. Available online: https://scikit-learn.org/stable/modules/model_evaluation.html#metrics-and-scoring-quantifying-the-quality-of-predictions.
55. Network intrusion detection: A comparative study of four classifiers using the NSL-KDD and KDD’99 datasets
56. One-hot encoding and convolutional neural network based anomaly detection
57. Improving the performance of machine learning-based network intrusion detection systems on the UNSW-NB15 dataset10.1155/2021/5557577 ↗
58. Roy, A., and Singh, K.J. Multi-classification of UNSW-NB15 dataset for network anomaly detection system. Proceedings of the International Conference on Communication and Computational Technologies.
59. Kannari, P.R., Shariff, N.C., and Biradar, R.L. (2021). Network intrusion detection using sparse autoencoder with swish-PReLU activation model. J. Ambient. Intell. Humaniz. Comput., 1–13.10.1007/s12652-021-03077-0 ↗
60. Brownlee, J. (2019). A gentle introduction to imbalanced classification. Mach. Learn. Mastery, 22, Available online: https://machinelearningmastery.com/what-is-imbalanced-classification/.
61. Contrastive Learning Over Random Fourier Features for IoT Network Intrusion Detection10.1109/JIOT.2022.3214758 ↗
62. Network Intrusion Detection Based on Extended RBF Neural Network With Offline Reinforcement Learning10.1109/ACCESS.2021.3127689 ↗
63. Supervised contrastive learning over prototype-label embeddings for network intrusion detection10.1016/j.inffus.2021.09.014 ↗
64. Network intrusion detection with a novel hierarchy of distances between embeddings of hash IP addresses10.1016/j.knosys.2021.106887 ↗
65. Application of deep reinforcement learning to intrusion detection for supervised problems10.1016/j.eswa.2019.112963 ↗
66. Adversarial environment reinforcement learning algorithm for intrusion detection10.1016/j.comnet.2019.05.013 ↗
67. Variational data generative model for intrusion detection10.1007/s10115-018-1306-7 ↗
68. Lopez-Martin, M., Carro, B., Sanchez-Esguevillas, A., and Lloret, J. (2017). Conditional variational autoencoder for prediction and feature recovery applied to intrusion detection in iot. Sensors, 17.10.3390/s17091967 ↗
69. Benedetti, D., Agnelli, J., Gagliardi, A., Dini, P., and Saponara, S. (2020, January 9–12). Design of a digital dashboard on low-cost embedded platform in a fully electric vehicle. Proceedings of the 2020 IEEE International Conference on Environment and Electrical Engineering and 2020 IEEE Industrial and Commercial Power Systems Europe (EEEIC/I&CPS Europe), Madrid, Spain.10.1109/EEEIC/ICPSEurope49358.2020.9160509 ↗
70. Processor-in-the-loop validation of a gradient descent-based model predictive control for assisted driving and obstacles avoidance applications10.1109/ACCESS.2022.3186020 ↗
71. Dini, P., and Saponara, S. (2021). Model-Based Design of an Improved Electric Drive Controller for High-Precision Applications Based on Feedback Linearization Technique. Electronics, 10.10.3390/electronics10232954 ↗
72. Cosimi, F., Dini, P., Giannetti, S., Petrelli, M., and Saponara, S. (2021). Proceedings of the Applications in Electronics Pervading Industry, Environment and Society: APPLEPIES 2020 8, Springer.
73. Bernardeschi, C., Dini, P., Domenici, A., Mouhagir, A., Palmieri, M., Saponara, S., Sassolas, T., and Zaourar, L. (2022). Software Engineering and Formal Methods, Proceedings of the SEFM 2021 Collocated Workshops: CIFMA, CoSim-CPS, OpenCERT, ASYDE, Virtual Event, 6–10 December 2021, Springer. Revised Selected Papers.
74. Begni, A., Dini, P., and Saponara, S. (2023). Applications in Electronics Pervading Industry, Environment and Society: APPLEPIES 2022, Springer.
75. Bernardeschi, C., Dini, P., Domenici, A., Palmieri, M., and Saponara, S. (2023). Software Engineering and Formal Methods, Proceedings of the SEFM 2022 Collocated Workshops: AI4EA, F-IDE, CoSim-CPS, CIFMA, Berlin, Germany, 26–30 September 2022, Springer. Revised Selected Papers.
76. Dini, P., and Saponara, S. (2019). Cogging torque reduction in brushless motors by a nonlinear control technique. Energies, 12.10.3390/en12112224 ↗
77. Dini, P., and Saponara, S. (2022). Electro-thermal model-based design of bidirectional on-board chargers in hybrid and full electric vehicles. Electronics, 11.10.3390/electronics11010112 ↗
78. Dini, P., and Saponara, S. (2020). Design of adaptive controller exploiting learning concepts applied to a BLDC-based drive system. Energies, 13.10.3390/en13102512 ↗
79. Dini, P., and Saponara, S. (2020). Design of an observer-based architecture and non-linear control algorithm for cogging torque reduction in synchronous motors. Energies, 13.10.3390/en13082077 ↗
80. Benedetti, D., Agnelli, J., Gagliardi, A., Dini, P., and Saponara, S. (2020, January 9–12). Design of an Off-Grid Photovoltaic Carport for a Full Electric Vehicle Recharging. Proceedings of the 2020 IEEE International Conference on Environment and Electrical Engineering and 2020 IEEE Industrial and Commercial Power Systems Europe (EEEIC/I&CPS Europe), Madrid, Spain.10.1109/EEEIC/ICPSEurope49358.2020.9160655 ↗
81. Bernardeschi, C., Dini, P., Domenici, A., Palmieri, M., and Saponara, S. (2020). Formal verification and co-simulation in the design of a synchronous motor control algorithm. Energies, 13.10.3390/en13164057 ↗
82. Dini, P., Ariaudo, G., Botto, G., Greca, F.L., and Saponara, S. (2023). Real-time electro-thermal modelling & predictive control design of resonant power converter in full electric vehicle applications. IET Power Electron.10.1049/pel2.12527 ↗