journal article·2024-09-03Open access

Residual Dense Optimization-Based Multi-Attention Transformer to Detect Network Intrusion against Cyber Attacks

Majid H. Alsulami

Applied Sciences· Volume 14· Issue 17

Abstract

Achieving cyber-security has grown increasingly tricky because of the rising concern for internet connectivity and the significant growth in software-related applications. It also needs a robust defense system to defend itself from multiple cyberattacks. Therefore, there is a need to generate a method for detecting and classifying cyber-attacks. The developed model can be integrated into three phases: pre-processing, feature selection, and classification. Initially, the min-max normalization of original data was performed to eliminate the impact of maximum or minimum values on the overall characteristics. After that, synthetic minority oversampling techniques (SMOTEs) were developed to reduce the number of minority attacks. The significant features were selected using a Hybrid Genetic Fire Hawk Optimizer (HGFHO). An optimized residual dense-assisted multi-attention transformer (Op-ReDMAT) model was introduced to classify selected features accurately. The proposed model’s performance was evaluated using the UNSW-NB15 and CICIDS2017 datasets. A performance analysis was carried out to demonstrate the effectiveness of the proposed model. The experimental results showed that the UNSW-NB15 dataset attained a higher precision, accuracy, F1-score, error rate, and recall of 97.2%, 98.82%, 97.8%, 2.58, and 98.5%, respectively. On the other hand, the CICIDS 2017 achieved a higher precision, accuracy, F1-score, and recall of 98.6%, 99.12%, 98.8%, and 98.2%, respectively.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Network Security and Intrusion Detection · Advanced Malware Detection Techniques · Anomaly Detection Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Applied College, Shaqra University, Shaqra 11961, Saudi Arabia

References (28)

Show source-provided references
1. Alqahtani, H., Sarker, I.H., Kalim, A., Minhaz Hossain, S.M., Ikhlaq, S., and Hossain, S. (2020, January 26–27). Cyber intrusion detection using machine learning classification techniques. Proceedings of the Computing Science, Communication and Security: First International Conference, COMS2 2020, Gujarat, India. Revised Selected Papers 1.10.1007/978-981-15-6648-6_10 ↗
2. Cyber intrusion detection by combined feature selection algorithm
3. Anwar, S., Mohamad Zain, J., Zolkipli, M.F., Inayat, Z., Khan, S., Anthony, B., and Chang, V. (2017). From intrusion detection to an intrusion response system: Fundamentals, requirements, and future directions. Algorithms, 10.10.3390/a10020039 ↗
4. A Novel Multimodal-Sequential Approach Based on Multi-View Features for Network Intrusion Detection10.1109/ACCESS.2019.2959131 ↗
5. Ring, M., Wunderlich, S., Gruedl, D., Landes, D., and Hotho, A. (2020, May 11). Generation Scripts for the Coburg Intrusion Detection Data Sets (Cidds). Available online: https://github.com/markusring/CIDDS.
6. Rashid, A., Siddique, M.J., and Ahmed, S.M. (2020, January 17–19). Machine and Deep Learning Based Comparative Analysis Using Hybrid Approaches for Intrusion Detection System. Proceedings of the 2020 3rd International Conference on Advancements in Computational Sciences (ICACS), Lahore, Pakistan.10.1109/ICACS47775.2020.9055946 ↗
7. Małowidzki, M., Berezinski, P., and Mazur, M. (2015, January 20–21). Network Intrusion Detection: Half a Kingdom for a Good Dataset. Proceedings of the NATO STO SAS-139 Workshop, Lisbon, Portugal. Available online: https://pdfs.semanticscholar.org/b39e/0f1568d8668d00e4a8bfe1494b5a32a17e17.pdf.
8. Al-Emadi, S., Al-Mohannadi, A., and Al-Senaid, F. (2020, January 2–5). Using deep learning techniques for network intrusion detection. Proceedings of the 2020 IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT), Doha, Qatar.10.1109/ICIoT48696.2020.9089524 ↗
9. Vinayakumar, R., Soman, K.P., and Poornachandran, P. (2017, January 13–16). Applying convolutional neural network for network intrusion detection. Proceedings of the 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Udupi, India.10.1109/ICACCI.2017.8126009 ↗
10. Ciaburro, G., and Venkateswaran, B. (2017). Neural Networks with R: Smart Models Using CNN, RNN, Deep Learning, and Artificial Intelligence Principles, Packt Publishing.
11. Optimization methods for large-scale machine learning10.1137/16M1080173 ↗
12. A review of anomaly-based intrusion detection systems
13. Hara, K., and Shiomoto, K. (2020, January 20–24). Intrusion detection system using semi-supervised learning with adversarial auto-encoder. Proceedings of the NOMS 2020-2020 IEEE/IFIP Network Operations and Management Symposium, Budapest, Hungary.10.1109/NOMS47738.2020.9110343 ↗
14. Cybersecurity data science: An overview from a machine learning perspective10.1186/s40537-020-00318-5 ↗
15. Sarker, I.H., Abushark, Y.B., Alsolami, F., and Khan, A.I. (2020). Intrudtree: A machine learning-based cyber security intrusion detection model. Symmetry, 12.10.20944/preprints202004.0481.v1 ↗
16. A novel two-stage deep learning model for network intrusion detection: LSTM-AE10.1109/ACCESS.2023.3266979 ↗
17. Kabir, M.H., Rajib, M.S., Rahman AS, M.T., Rahman, M.M., and Dey, S.K. (2022, January 24–26). Network intrusion detection using UNSW-NB15 dataset: Stacking machine learning based approach. Proceedings of the 2022 International Conference on Advancement in Electrical and Electronic Engineering (ICE), Gazipur, Bangladesh.10.1109/ICAEEE54957.2022.9836404 ↗
18. HC-DTTSVM: A network intrusion detection method based on decision tree twin support vector machine and hierarchical clustering10.1109/ACCESS.2023.3251354 ↗
19. An Improved Algorithm for Network Intrusion Detection Based on Deep Residual Networks10.1109/ACCESS.2024.3398007 ↗
20. El-Rady, A.A., Osama, H., Sadik, R., and El Badwy, H. (June, January 30). Network Intrusion Detection CNN Model for Realistic Network Attacks Based on Network Traffic Classification. Proceedings of the 2023 40th National Radio Science Conference (NRSC), Giza, Egypt.10.1109/NRSC58893.2023.10152872 ↗
21. NIDS-CNNLSTM: Network intrusion detection classification model based on deep learning10.1109/ACCESS.2023.3254915 ↗
22. Salazar, A., Vargas, N., Safont, G., and Vergara, L. (2021, January 15–17). Late Fusion for Improving Intrusion Detection in a Network Traffic Dataset. Proceedings of the 2021 International Conference on Computational Science and Computational Intelligence (CSCI), Las Vegas, NV, USA.10.1109/CSCI54926.2021.00320 ↗
23. Generative Adversarial Networks and Markov Random Fields for oversampling very small training sets10.1016/j.eswa.2020.113819 ↗
24. Imbalanced classification based on minority clustering smote with wind turbine fault detection application10.1109/TII.2020.3046566 ↗
25. Shishehgarkhaneh, M.B., Azizi, M., Basiri, M., and Moehler, R.C. (2022). BIM-based resource tradeoff in project scheduling using fire hawk optimizer (FHO). Buildings, 12.10.3390/buildings12091472 ↗
26. DTL-IDS: An optimized Intrusion Detection Framework using Deep Transfer Learning and Genetic Algorithm10.1016/j.jnca.2023.103784 ↗
27. Figueiredo, J., Serrão, C., and de Almeida, A.M. (2023). Deep learning model transposition for network intrusion detection systems. Electronics, 12.10.3390/electronics12020293 ↗
28. Rao, Y.N., and Suresh Babu, K. (2023). An imbalanced generative adversarial network-based approach for network intrusion detection in an imbalanced dataset. Sensors, 23.10.3390/s23010550 ↗