journal article·2023-09-19Open access

An Intrusion Detection Method Based on Hybrid Machine Learning and Neural Network in the Industrial Control Field

Duo Sun, Lei Zhang, Kai Jin, Jiasheng Ling, Xiaoyuan Zheng

Applied Sciences· Volume 13· Issue 18

Abstract

Aiming at the imbalance of industrial control system data and the poor detection effect of industrial control intrusion detection systems on network attack traffic problems, we propose an ETM-TBD model based on hybrid machine learning and neural network models. Aiming at the problem of high dimensionality and imbalance in the amount of sample data in the massive data of industrial control systems, this paper proposes an IG-based feature selection method and an oversampling method for SMOTE. In the ETM-TBD model, we propose a hyperparameter optimization method based on Bayesian optimization used to optimize the parameters of the four basic machine learners in the model. By introducing a multi-head-attention mechanism, the Transformer module increases the attention between local features and global features, enabling the discovery of the internal relationship between features. Additionally, the BiGRU is used to preserve the temporal features of the dataset, while the DNN is used to extract deeper features. Finally, the SoftMax classifier is used to classify the output. By analyzing the results of the comparison and ablation experiments, it can be concluded that the F1-score of the ETM-TBD model on a robotic arm dataset is 0.9665 and the model has very low FNR and FPR scores of 0.0263 and 0.0081, respectively. It can be seen that the model in this paper is better than the traditional single machine learning algorithm as well as the algorithm lacking any of the modules.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Network Security and Intrusion Detection · Anomaly Detection Techniques and Applications · Smart Grid Security and Resilience

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Artificial Intelligence and Data Science, Hebei University of Technology, Tianjin 300132, China

References (34)

Show source-provided references
1. Multilayer data-driven cyber-attack detection system for industrial control systems based on network, system, and process data10.1109/TII.2019.2891261 ↗
2. Networked control systems: A survey of trends and techniques
3. Artificial intelligence for detection, estimation, and compensation of malicious attacks in nonlinear cyber-physical systems and industrial IoT10.1109/TII.2019.2956474 ↗
4. An experimental analysis of security vulnerabilities in industrial IoT devices10.1145/3379542 ↗
5. IoT malicious traffic identification using wrapper-based feature selection mechanisms10.1016/j.cose.2020.101863 ↗
6. Fu, C., Li, Q., Shen, M., Li, W., and Zhang, Y. (2021, January 15–19). Realtime robust malicious traffic detection via frequency domain analysis. Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security, Virtual Event.10.1145/3460120.3484585 ↗
7. Machine learning for encrypted malicious traffic detection: Approaches, datasets and comparative study10.1016/j.cose.2021.102542 ↗
8. Apply machine learning techniques to detect malicious network traffic in cloud computing10.1186/s40537-021-00475-1 ↗
9. A survey of convolutional neural networks: Analysis, applications, and prospects10.1109/TNNLS.2021.3084827 ↗
10. Hybrid Intrusion Detection using MapReduce based Black Widow Optimized Convolutional Long Short-Term Memory Neural Networks10.1016/j.eswa.2022.116545 ↗
11. Employing a Machine Learning Approach to Detect Combined Internet of Things Attacks against Two Objective Functions Using a Novel Dataset10.1155/2020/2804291 ↗
12. Deep Learning Approach for Intelligent Intrusion Detection System10.1109/ACCESS.2019.2895334 ↗
13. Peng, W., Kong, X., Peng, G., Li, X., and Wang, Z. (2019, January 5–9). Network intrusion detection based on deep learning. Proceedings of the 2019 International Conference on Communications, Information System and Computer Engineering (CISCE), Haikou, China.10.1109/CISCE.2019.00102 ↗
14. Intrusion detection model using machine learning algorithm on Big Data environment10.1186/s40537-018-0145-4 ↗
15. Lv, H., Du, Y., Zhou, X., Ni, W., and Ma, X. (2023). A Data Enhancement Algorithm for DDoS Attacks Using IoT. Sensors, 23.10.3390/s23177496 ↗
16. Chen, C., Guo, X., Zhang, W., Zhao, Y., Wang, B., Ma, B., and Wei, D. (2023). Application of GA-WELM Model Based on Stratified Cross-Validation in Intrusion Detection. Symmetry, 15.10.3390/sym15091719 ↗
17. Kilichev, D., and Kim, W. (2023). Hyperparameter Optimization for 1D-CNN-Based Network Intrusion Detection Using GA and PSO. Mathematics, 11.10.3390/math11173724 ↗
18. Yang, H., Xu, J., Xiao, Y., and Hu, L. (2023). SPE-ACGAN: A Resampling Approach for Class Imbalance Problem in Network Intrusion Detection Systems. Electronics, 12.10.3390/electronics12153323 ↗
19. Anomaly-based intrusion detection system for IoT networks through deep learning model10.1016/j.compeleceng.2022.107810 ↗
20. Deep SMOTE: Fusing deep learning and SMOTE for imbalanced data10.1109/TNNLS.2021.3136503 ↗
21. Gao, Z., Li, Z., Luo, J., Li, Y., and Li, S. (2022). Short text aspect-based sentiment analysis based on CNN+BiGRU. Appl. Sci., 12.10.3390/app12052707 ↗
22. A multi-tiered feature selection model for android malware detection based on feature discrimination and information gain
23. Integrated early fault diagnosis method based on direct fast iterative filtering decomposition and effective weighted sparseness kurtosis to rolling bearings10.1016/j.ymssp.2022.108897 ↗
24. Injadat, M.N., Moubayed, A., and Shami, A. (2020, January 14–17). Detecting botnet attacks in IoT environments: An optimized machine learning approach. Proceedings of the 2020 32nd International Conference on Microelectronics (ICM), Aqaba, Jordan.10.1109/ICM50269.2020.9331794 ↗
25. A comparative analysis of K-Nearest Neighbour, Genetic, Support Vector Machine, Decision Tree, and Long Short Term Memory algorithms in machine learning10.1016/j.dajour.2022.100071 ↗
26. Balyan, A.K., Ahuja, S., Lilhore, U.K., Singh, S.P., and Kumar, A. (2022). A hybrid intrusion detection model using EGA-PSO and improved random forest method. Sensors, 22.10.3390/s22165986 ↗
27. Predictive performances of ensemble machine learning algorithms in landslide susceptibility mapping using random forest, extreme gradient boosting (XGBoost) and natural gradient boosting (NGBoost)10.1007/s13369-022-06560-8 ↗
28. Utrad: Anomaly detection and localization with U-Transformer10.1016/j.neunet.2021.12.008 ↗
29. Displacement prediction of Jiuxianping landslide using gated recurrent unit (GRU) networks10.1007/s11440-022-01495-8 ↗
30. AlHaddad, U., Basuhail, A., Khemakhem, M., Eassa, F.E., and Jambi, K. (2023). Ensemble Model Based on Hybrid Deep Learning for Intrusion Detection in Smart Grid Networks. Sensors, 23.10.3390/s23177464 ↗
31. Xiang, G., Shi, C., and Zhang, Y. (2023). An APT Event Extraction Method Based on BERT-BiGRU-CRF for APT Attack Detection. Electronics, 12.10.3390/electronics12153349 ↗
32. Yang, T., Li, G., Wang, T., Yuan, S., Yang, X., Yu, X., and Han, Q. (2023). A Novel 1D-Convolutional Spatial-Time Fusion Strategy for Data-Driven Fault Diagnosis of Aero-Hydraulic Pipeline Systems. Mathematics, 11.10.3390/math11143113 ↗
33. Pkd: General distillation framework for object detectors via pearson correlation coefficient
34. A new correlation coefficient between categorical, ordinal and interval variables with Pearson characteristics10.1016/j.csda.2020.107043 ↗