journal article·2021-02-13Open access

Intelligent Cyber Attack Detection and Classification for Network-Based Intrusion Detection Systems

Nuno Oliveira, Isabel Praça, Eva Maia, Orlando Sousa

Applied Sciences· Volume 11· Issue 4

Abstract

With the latest advances in information and communication technologies, greater amounts of sensitive user and corporate information are shared continuously across the network, making it susceptible to an attack that can compromise data confidentiality, integrity, and availability. Intrusion Detection Systems (IDS) are important security mechanisms that can perform the timely detection of malicious events through the inspection of network traffic or host-based logs. Many machine learning techniques have proven to be successful at conducting anomaly detection throughout the years, but only a few considered the sequential nature of data. This work proposes a sequential approach and evaluates the performance of a Random Forest (RF), a Multi-Layer Perceptron (MLP), and a Long-Short Term Memory (LSTM) on the CIDDS-001 dataset. The resulting performance measures of this particular approach are compared with the ones obtained from a more traditional one, which only considers individual flow information, in order to determine which methodology best suits the concerned scenario. The experimental outcomes suggest that anomaly detection can be better addressed from a sequential perspective. The LSTM is a highly reliable model for acquiring sequential patterns in network traffic data, achieving an accuracy of 99.94% and an f1-score of 91.66%.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Network Security and Intrusion Detection · Internet Traffic Analysis and Secure E-voting · Anomaly Detection Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Research Group on Intelligent Engineering and Computing for Advanced Innovation and Development (GECAD), Porto School of Engineering (ISEP), 4200-072 Porto, Portugal

Funding

European Union Horizon 2020

References (42)

Show source-provided references
1. Towards a taxonomy of intrusion-detection systems10.1016/S1389-1286(98)00017-6 ↗
2. Rashid, A., Siddique, M.J., and Ahmed, S.M. (2020, January 17–19). Machine and Deep Learning Based Comparative Analysis Using Hybrid Approaches for Intrusion Detection System. Proceedings of the 2020 3rd International Conference on Advancements in Computational Sciences (ICACS), Lahore, Pakistan.10.1109/ICACS47775.2020.9055946 ↗
3. A Novel Multimodal-Sequential Approach Based on Multi-View Features for Network Intrusion Detection10.1109/ACCESS.2019.2959131 ↗
4. Introducing Deep Learning Self-Adaptive Misuse Network Intrusion Detection Systems10.1109/ACCESS.2019.2893871 ↗
5. Hu, Z., Li, Z., and Wu, J. (2008, January 23–24). A Novel Network Intrusion Detection System (NIDS) Based on Signatures Search of Data Mining. Proceedings of the First International Workshop on Knowledge Discovery and Data Mining (WKDD 2008), Adelaide, SA, Australia.
6. Deep Learning Approach for Intelligent Intrusion Detection System10.1109/ACCESS.2019.2895334 ↗
7. Małowidzki, M., Berezinski, P., and Mazur, M. (2015). Network Intrusion Detection: Half a Kingdom for a Good Dataset. Proceedings of the NATO STO SAS-139 Workshop, Available online: https://pdfs.semanticscholar.org/b39e/0f1568d8668d00e4a8bfe1494b5a32a17e17.pdf.
8. Ring, M., Wunderlich, S., Gruedl, D., Landes, D., and Hotho, A. Flow-based benchmark data sets for intrusion detection. Proceedings of the 16th European Conference on Cyber Warfare and Security (ECCWS).
9. Creation of Flow-Based Data Sets for Intrusion Detection
10. Sharafaldin, I., Habibi Lashkari, A., and Ghorbani, A. (2018). Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization. ICISSP, University of New Brunswick (UNB).10.5220/0006639801080116 ↗
11. Moustafa, N., and Slay, J. (2015, January 10–12). UNSW-NB15: A comprehensive data set for network intrusion detection systems (UNSW-NB15 network data set). Proceedings of the 2015 Military Communications and Information Systems Conference (MilCIS), Canberra, ACT, Australia.10.1109/MilCIS.2015.7348942 ↗
12. A survey of network-based intrusion detection data sets10.1016/j.cose.2019.06.005 ↗
13. (2020, September 02). SATIE-Security of Air Transport Infrastructure of Europe. Available online: http://satie-h2020.eu/.
14. Gwon, H., Lee, C., Keum, R., and Choi, H. (2019). Network Intrusion Detection based on LSTM and Feature Embedding. arXiv.
15. Althubiti, S.A., Jones, E.M., and Roy, K. (2018, January 21–23). LSTM for Anomaly-Based Network Intrusion Detection. Proceedings of the 2018 28th International Telecommunication Networks and Applications Conference (ITNAC), Sydney, NSW, Australia.10.1109/ATNAC.2018.8615300 ↗
16. Attack Classification Analysis of IoT Network via Deep Learning Approach
17. Vilela, D.W.F.L., Ferreira, E.W.T., Shinoda, A.A., de Souza Araújo, N.V., de Oliveira, R., and Nascimento, V.E. (2014, January 4–6). A dataset for evaluating intrusion detection systems in IEEE 802.11 wireless networks. Proceedings of the 2014 IEEE Colombian Conference on Communications and Computing (COLCOM), Bogota, Colombia.10.1109/ColComCon.2014.6860434 ↗
18. Statistical analysis of CIDDS-001 dataset for Network Intrusion Detection Systems using Distance-based Machine Learning10.1016/j.procs.2017.12.091 ↗
19. Study of long short-term memory in flow-based network intrusion detection system10.3233/JIFS-169836 ↗
20. Deep and Machine Learning Approaches for Anomaly-Based Intrusion Detection of Imbalanced Network Traffic10.1109/LSENS.2018.2879990 ↗
21. Roy, B., and Cheung, H. (2018, January 21–23). A Deep Learning Approach for Intrusion Detection in Internet of Things using Bi-Directional Long Short-Term Memory Recurrent Neural Network. Proceedings of the 2018 28th International Telecommunication Networks and Applications Conference (ITNAC), Sydney, NSW, Australia.10.1109/ATNAC.2018.8615294 ↗
22. Performance Analysis of Machine Learning Algorithms in Intrusion Detection System: A Review10.1016/j.procs.2020.04.133 ↗
23. Machine Learning Based Intrusion Detection Systems for IoT Applications10.1007/s11277-019-06986-8 ↗
24. Ring, M., Wunderlich, S., Gruedl, D., Landes, D., and Hotho, A. (2020, May 11). Generation Scripts for the Coburg Intrusion Detection Data Sets (Cidds). Available online: https://github.com/markusring/CIDDS.
25. Zhiqiang, L., Mohi-Ud-Din, G., Bing, L., Jianchao, L., Ye, Z., and Zhijun, L. (2019, January 12–14). Modeling Network Intrusion Detection System Using Feed-Forward Neural Network Using UNSW-NB15 Dataset. Proceedings of the 2019 IEEE 7th International Conference on Smart Energy Grid Engineering (SEGE), Oshawa, ON, Canada.10.1109/SEGE.2019.8859773 ↗
26. Random forests10.1023/A:1010933404324 ↗
27. Yiu, T. (2020, May 15). Understanding Random Forest. Available online: https://towardsdatascience.com/understanding-random-forest-58381e0602d2.
28. Cournapeau, D. (2020, May 15). Scikit-learn Documentation. Available online: https://scikit-learn.org/.
29. Kain, N.K. (2020, May 26). Understanding of Multilayer Perceptron (MLP). Available online: https://medium.com/@AI_with_Kain/understanding-of-multilayer-perceptron-mlp-8f179c4a135f/.
30. Deep Sparse Rectifier Neural Networks
31. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗
32. A Review on the Long Short-Term Memory Model10.1007/s10462-020-09838-1 ↗
33. McGonagle, J., Williams, C., and Khim, J. (2020, May 12). Recurrent Neural Network. Available online: https://brilliant.org/wiki/recurrent-neural-network/.
34. Olah, C. (2020, May 14). Understanding LSTM Networks. Available online: https://colah.github.io/posts/2015-08-Understanding-LSTMs/.
35. A systematic analysis of performance measures for classification tasks10.1016/j.ipm.2009.03.002 ↗
36. Döring, M. (2020, May 15). Performance Measures for Multi-Class Problems. Available online: https://www.datascienceblog.net/post/machine-learning/performance-measures-multi-class-problems/.
37. Oliphant, T. (2020, May 19). NumPy Documentation. Available online: https://numpy.org/index.html.
38. McKinney, W. (2020, May 16). Pandas Documentation. Available online: https://pandas.pydata.org/.
39. Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., and Isard, M. (2016, January 2–4). TensorFlow: A System for Large-Scale Machine Learning. Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), Savannah, GA, USA.
40. Chollet, F. (2020, May 20). Keras Documentation. Available online: https://keras.io/.
41. Hunter, J.D. (2020, May 19). Matplotlib Documentation. Available online: https://matplotlib.org/.
42. Bisong, E. (2019). Google Colaboratory. Building Machine Learning and Deep Learning Models on Google Cloud Platform: A Comprehensive Guide for Beginners, Apress.10.1007/978-1-4842-4470-8 ↗