Analysis of ToN-IoT, UNW-NB15, and Edge-IIoT Datasets Using DL in Cybersecurity for IoT
Source abstract
Abstract
The IoT’s quick development has brought up several security problems and issues that cannot be solved using traditional intelligent systems. Deep learning (DL) in the field of artificial intelligence (AI) has proven to be efficient, with many advantages that can be used to address IoT cybersecurity concerns. This study trained two models of intelligent networks—namely, DenseNet and Inception Time—to detect cyber-attacks based on a multi-class classification method. We began our investigation by measuring the performance of these two networks using three datasets: the ToN-IoT dataset, which consists of heterogeneous data; the Edge-IIoT dataset; and the UNSW2015 dataset. Then, the results were compared by identifying several cyber-attacks. Extensive experiments were conducted on standard ToN-IoT datasets using the DenseNet multicategory classification model. The best result we obtained was an accuracy of 99.9% for Windows 10 with DenseNet, but by using the Inception Time approach we obtained the highest result for Windows 10 with the network, with 100% accuracy. As for using the Edge-IIoT dataset with the Inception Time approach, the best result was an accuracy of 94.94%. The attacks were also assessed in the UNSW-NB15 database using the Inception Time approach, which had an accuracy rate of 98.4%. Using window sequences for the sliding window approach and a six-window size to start training the Inception Time model yielded a slight improvement, with an accuracy rate of 98.6% in the multicategory classification.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Network Security and Intrusion Detection · Advanced Malware Detection Techniques · Anomaly Detection Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Computer and Information Sciences, Ain Shams University, Cairo 11566, Egypt
References (38)
Show source-provided references
1. A survey of emerging threats in cybersecurity10.1016/j.jcss.2014.02.005 ↗
2. Drew, J., Moore, T., and Hahsler, M. (2016, January 22–26). Polymorphic Malware Detection Using Sequence Classification Methods. Proceedings of the 2016 IEEE Security and Privacy Workshops (SPW), San Jose, CA, USA.10.1109/SPW.2016.30 ↗
3. Metamorphic Malware Detection Using Code Metrics10.1080/19393555.2014.931487 ↗
4. Nataraj, L., Karthikeyan, S., Jacob, G., and Manjunath, B.S. (2022, April 06). 2011__Malware Images, Visualization and Automatic. Available online: https://vision.ece.ucsb.edu/sites/vision.ece.ucsb.edu/files/publications/nataraj_vizsec_2011_paper.pdf.10.1145/2016904.2016908 ↗
5. Detecting and Classifying Android Malware Using Static Analysis along with Creator Information10.1155/2015/479174 ↗
6. MalDAE: Detecting and explaining malware based on correlation and fusion of static and dynamic characteristics10.1016/j.cose.2019.02.007 ↗
7. A multi-level deep learning system for malware detection10.1016/j.eswa.2019.04.064 ↗
8. Agarap, A.F. (2022, April 13). Towards Building an Intelligent Anti-Malware System: A Deep Learning Approach Using Support Vector Machine (SVM) for Malware Classification, No. 1. Available online: http://arxiv.org/abs/1801.00318.
9. A feature-hybrid malware variants detection using CNN based opcode embedding and BPNN based API embedding10.1016/j.cose.2019.04.005 ↗
10. Liu, H., and Lang, B. (2019). Machine Learning and Deep Learning Methods for Intrusion Detection Systems: A Survey. Appl. Sci., 9.10.3390/app9204396 ↗
11. Fong, R.C., and Vedaldi, A. (2017). Interpretable Explanations of Black Boxes by Meaningful Perturbation. arXiv.10.1109/ICCV.2017.371 ↗
12. Intrusion Detection System Using Machine Learning for Vehicular Ad Hoc Networks Based on ToN-IoT Dataset10.1109/ACCESS.2021.3120626 ↗
13. Singh, P., Jishnu Jaykumar, P., Pankaj, A., and Mitra, R. (2021, January 9–12). Edge-Detect: Edge-Centric Network Intrusion Detection using Deep Neural Network. Proceedings of the 2021 IEEE 18th Annual Consumer Communications & Networking Conference (CCNC), Las Vegas, NV, USA.10.1109/CCNC49032.2021.9369469 ↗
14. P2IDF: A Privacy-Preserving based Intrusion Detection Framework for Soft-ware Defined Internet of Things-Fog (SDIoT-Fog)
15. TP2SF: A Trustworthy Privacy-Preserving Secured Framework for sustainable smart cities by leveraging blockchain and machine learning10.1016/j.sysarc.2020.101954 ↗
16. Deep-intrusion detection system with enhanced UNSW-NB15 dataset based on deep learning techniques
17. Yin, Y., Jang-Jaccard, J., Xu, W., Singh, A., Zhu, J., Sabrina, F., and Kwak, J. (2022, May 19). IGRF-RFE: A Hybrid Feature Selection Method for MLP-Based Network Intrusion Detection on UNSW-NB15 Dataset. Available online: http://arxiv.org/abs/2203.16365.10.1186/s40537-023-00694-8 ↗
18. A distributed ensemble design based intrusion detection system using fog computing to protect the internet of things networks10.1007/s12652-020-02696-3 ↗
19. Wu, P., Moustafa, N., Yang, S., and Guo, H. (2020–1, January 29). Densely Connected Residual Network for Attack Recognition. Proceedings of the 2020 IEEE 19th International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom), Guangzhou, China.10.1109/TrustCom50675.2020.00042 ↗
20. Sarhan, M., Layeghy, S., and Portmann, M. (2022, May 19). Feature Analysis for ML-based IIoT Intrusion Detection. Available online: http://arxiv.org/abs/2108.12732.10.21203/rs.3.rs-2035633/v1 ↗
21. A new distributed architecture for evaluating AI-based security systems at the edge: Network TON_IoT datasets10.1016/j.scs.2021.102994 ↗
22. Edge-IIoTset: A New Comprehensive Realistic Cyber Security Dataset of IoT and IIoT Applications for Centralized and Federated Learning10.1109/ACCESS.2022.3165809 ↗
23. Alzubaidi, L., Zhang, J., Humaidi, A.J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M.A., Al-Amidie, M., and Farhan, L. (2021). Review of Deep Learning: Concepts, CNN Architectures, Challenges, Applications, Future Directions, Springer International Publishing.10.1186/s40537-021-00444-8 ↗
24. Effective Data Augmentation and Training Techniques for Improving Deep Learning in Plant Leaf Disease Recognition
25. Moustafa, N. (2022, April 03). ToN_IoT and unsw15 Datasets. Available online: https://research.unsw.edu.au/projects/toniot-datasets.
26. Ferrag, M.A. (2022, May 08). EdgeIIoTset. Available online: https://www.kaggle.com/datasets/mohamedamineferrag/edgeiiotset-cyber-security-dataset-of-iot-iiot.
27. Federated Deep Learning for Cyber Security in the Internet of Things: Concepts, Applications, and Experimental Analysis10.1109/ACCESS.2021.3118642 ↗
28. Bagui, S., Walauskis, M., Derush, R., Praviset, H., and Boucugnani, S. (2022). Spark Configurations to Optimize Decision Tree Classi-fication on UNSW-NB15. Big Data Cogn. Comput., 6.10.3390/bdcc6020038 ↗
29. Huang, G., Liu, Z., Pleiss, G., Van Der Maaten, L., and Weinberger, K. (2019). Convolutional Networks with Dense Connectivity. IEEE Trans. Pattern Anal. Mach. Intell.
30. Ji, Q., Huang, J., He, W., and Sun, Y. (2019). Optimized Deep Convolutional Neural Networks for Identification of Macular Diseases from Optical Coherence Tomography Images. Algorithms, 12.10.3390/a12030051 ↗
31. Deep learning for time series classification: A review10.1007/s10618-019-00619-1 ↗
32. InceptionTime: Finding AlexNet for time series classification10.1007/s10618-020-00710-y ↗
33. Dunn, C., Moustafa, N., and Turnbull, B. (2020). Robustness Evaluations of Sustainable Machine Learning Models Against Data Poisoning Attacks in the Internet of Things. Sustainability, 12.10.3390/su12166434 ↗
34. TON_IoT Telemetry Dataset: A New Generation Dataset of IoT and IIoT for Data-Driven Intrusion Detection Systems10.1109/ACCESS.2020.3022862 ↗
35. An Ensemble-Based Multi-class Classifier for Intrusion Detection Using Internet of Things10.1155/2022/1668676 ↗
36. Khamis, R.A., and Matrawy, A. (2020, January 20–22). Evaluation of Adversarial Training on Different Types of Neural Networks in Deep Learning-based IDSs. Proceedings of the 2020 International Symposium on Networks, Computers and Communications (ISNCC), Montreal, QC, Canada.10.1109/ISNCC49221.2020.9297344 ↗
37. UNSW-NB15 dataset feature selection and network intrusion detection using deep learning
38. Performance Analysis of Intrusion Detection Systems Using a Feature Selection Method on the UNSW-NB15 Dataset10.1186/s40537-020-00379-6 ↗