Ensemble Learning for Threat Classification in Network Intrusion Detection on a Security Monitoring System for Renewable Energy
Source abstract
Abstract
Most approaches for detecting network attacks involve threat analyses to match the attack to potential malicious profiles using behavioral analysis techniques in conjunction with packet collection, filtering, and feature comparison. Experts in information security are often required to study these threats, and judging new types of threats accurately in real time is often impossible. Detecting legitimate or malicious connections using protocol analysis is difficult; therefore, machine learning-based function modules can be added to intrusion detection systems to assist experts in accurately judging threat categories by analyzing the threat and learning its characteristics. In this paper, an ensemble learning scheme based on a revised random forest algorithm is proposed for a security monitoring system in the domain of renewable energy to categorize network threats in a network intrusion detection system. To reduce classification error for minority classes of experimental data in model training, the synthetic minority oversampling technique scheme (SMOTE) was formulated to re-balance the original data sets by altering the number of data points for minority class to imbue the experimental data set. The classification performance of the proposed classifier in threat classification when the data set is unbalanced was experimentally verified in terms of accuracy, precision, recall, and F1-score on the UNSW-NB15 and CSE-CIC-IDS 2018 data sets. A cross-validation scheme featuring support vector machines was used to compare classification accuracies.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Network Security and Intrusion Detection · Internet Traffic Analysis and Secure E-voting · Spam and Phishing Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Green Energy Technology Research Center, Faculty of Department of Information Management, Kun Shan University, Tainan 710303, Taiwan
Engineering and Computing, School of MIS, Coventry University, Coventry CV1 5FB, UK
Funding
Ministry of Science and Technology of Taiwan
References (32)
Show source-provided references
1. Damien, R., Gilles, G., and Michaël, H. (2012, January 4–6). Large-scale coordinated attacks: Impact on the cloud security. Proceedings of the 6th International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing (IMIS 2012), Palermo, Italy.
2. Al-Jarrah, O., and Arafat, A. (2014, January 1–3). Network intrusion detection system using attack behavior classification. Proceedings of the 5th International Conference on Information and Communication Systems, ICICS2014, Irbid, Jordan.10.1109/IACS.2014.6841978 ↗
3. Bernhard, E.B., Isabelle, M.G., Vapnik, V., and Vladimir, N. (1992, January 27–29). A Training algorithm for optimal margin classifiers. Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory, Pittsburgh, PA, USA.
4. Guan, X., Guo, H., and Chen, L. (2010, January 16–18). Network intrusion detection based on agent and SVM. Proceedings of the 2nd IEEE International Conference on Information Management and Engineering (ICIME), Chengdu, China.
5. Li, L., Gao, Z.P., and Ding, W.Y. (2010, January 25–27). Fuzzy multi-class support vector machine based on binary tree in network intrusion detection. Proceedings of the 2010 International Conference on Electrical and Control Engineering (ICECE), Wuhan, China.10.1109/iCECE.2010.264 ↗
6. Kausar, N., Samir, B.B., Sulaiman, S.B., Ahmad, I., and Hussain, M. (2012, January 12–14). An approach towards intrusion detection using PCA feature subsets and SVM. Proceedings of the 2012 International Conference on Computer & Information Science (ICCIS), Shanghai, China.10.1109/ICCISci.2012.6297095 ↗
7. Singh, S., Singh, J.P., and Shrivastva, G. (2013, January 4–6). A Hybrid Artificial Immune System for IDS based on SVM and Belief Function. Proceedings of the Fourth IEEE International Conference on Computing, Communications and Networking Technologies (ICCCNT), Tiruchengode, India.10.1109/ICCCNT.2013.6726835 ↗
8. Ho, T.K. (1995, January 14–18). Random decision forest. Proceedings of the 3rd International Conference on Document Analysis and Recognition, Montreal, QB, Canada.
9. The random subspace method for constructing decision forests10.1109/34.709601 ↗
10. Random-forests-based Network Intrusion Detection Systems10.1109/TSMCC.2008.923876 ↗
11. Zhou, Z.H. (2012). Ensemble Methods: Foundations and Algorithms, Chapman and Hall/CRC.10.1201/b12207 ↗
12. Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., Ye, Q., and Liu, T.Y. (2017, January 2–9). LightGBM: A highly efficient gradient boosting decision tree. Proceedings of the 31st Conference on Neural Information Processing Systems, NIPS 2017, Long Beach, CA, USA.
13. Rocca, J. (2021, September 12). Ensemble Methods: Bagging, Boosting and Stacking. Available online: https://towardsdatascience.com/ensemble-methods-bagging-boosting-and-stacking-c9214a10a205.
14. Two-stage classifier approach for network intrusion detection10.1007/978-3-319-99807-7_20 ↗
15. Moustafa, N., and Slay, J. (2015, January 10–12). UNSW-NB15: A Comprehensive data set for network intrusion detection systems (UNSW-NB15 network data set). Proceedings of the Military Communications and Information Systems Conference (MilCIS), Canberra, Australia.10.1109/MilCIS.2015.7348942 ↗
16. Canadian Institute for Cybersecurity (2021, November 18). CSE-CIC-IDS2018 on AWS. Available online: https://www.unb.ca/cic/datasets/ids-2018.html.
17. Performance analysis of intrusion detection systems using a feature selection method on the UNSW-NB15 Dataset10.1186/s40537-020-00379-6 ↗
18. SMOTE: Synthetic minority over-sampling technique10.1613/jair.953 ↗
19. Increasing the performance of machine learning-based IDSs on an imbalanced and up-to-date Dataset10.1109/ACCESS.2020.2973219 ↗
20. Network intrusion detection based on PSO-XGBoost model10.1109/ACCESS.2020.2982418 ↗
21. Tan, X., Su, S., Huang, Z., Guo, X., Zuo, Z., Sun, Z., and Li, L. (2019). Wireless sensor networks intrusion detection based on SMOTE and the random forest algorithm. Sensors, 19.10.3390/s19010203 ↗
22. Blagus, R., and Lusa, L. (2013). SMOTE for High-dimensional Class-imbalanced Data. BMC Bioinform., 14.10.1186/1471-2105-14-106 ↗
23. Classification of imbalanced big data using SMOTE with rough random forest10.35940/ijeat.B4096.129219 ↗
24. A GBDT-paralleled quadratic ensemble learning for intrusion detection system
25. Wu, T., Fan, H., Zhu, H.J., You, C.Z., Zhou, H.Y., and Huang, X.Z. (2021). Intrusion detection system combined enhanced random forest with SMOTE algorithm. J. Adv. Signal Process.10.1186/s13634-022-00871-6 ↗
26. An intrusion detection model based on SMOTE and convolutional neural network ensemble10.1088/1742-6596/1828/1/012024 ↗
27. Supervised machine learning: A review of classification techniques
28. Kononenko, I. (1995, January 20–25). On biases in estimating multi-valued attributes. Proceedings of the 14th International Joint Conference on Artificial Intelligence, Montreal, QB, Canada.
29. Abdulhammed, R., Musafer, H., Alessa, A., Faezipour, M., and Abuzneid, A. (2019). Features dimensionality reduction approaches for machine learning based network intrusion detection. Electronics, 8.10.3390/electronics8030322 ↗
30. Cyber Range Lab of the Australian Centre (2021, March 25). UNSW-NB15 Data Set. Available online: https://research.unsw.edu.au/projects/unsw-nb15-dataset.
31. Ramon, J. (2021, September 12). Comment on: How to Determine the Number of Trees to be Generated in Random Forest Algorithm. Available online: https://www.researchgate.net/post/How_to_determine_the_number_of_trees_to_be_generated_in_Random_Forest_algorithm.
32. Huancayo Ramos, K.S., Sotelo Monge, M.A., and Maestre Vidal, J. (2020). Benchmark-based reference model for evaluating botnet detection tools driven by traffic-flow analytics. Sensors, 20.10.3390/s20164501 ↗