Detecting Vulnerabilities in Critical Infrastructures by Classifying Exposed Industrial Control Systems Using Deep Learning
Source abstract
Abstract
Industrial control systems depend heavily on security and monitoring protocols. Several tools are available for this purpose, which scout vulnerabilities and take screenshots of various control panels for later analysis. However, they do not adequately classify images into specific control groups, which is crucial for security-based tasks performed by manual operators. To solve this problem, we propose a pipeline based on deep learning to classify snapshots of industrial control panels into three categories: internet technologies, operation technologies, and others. More specifically, we compare the use of transfer learning and fine-tuning in convolutional neural networks (CNNs) pre-trained on ImageNet to select the best CNN architecture for classifying the screenshots of industrial control systems. We propose the critical infrastructure dataset (CRINF-300), which is the first publicly available information technology (IT)/operational technology (OT) snapshot dataset, with 337 manually labeled images. We used the CRINF-300 to train and evaluate eighteen different pipelines, registering their performance under CPU and GPU environments. We found out that the Inception-ResNet-V2 and VGG16 architectures obtained the best results on transfer learning and fine-tuning, with F1-scores of 0.9832 and 0.9373, respectively. In systems where time is critical and the GPU is available, we recommend using the MobileNet-V1 architecture, with an average time of 0.03 s to process an image and with an F1-score of 0.9758.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Adversarial Robustness in Machine Learning · Anomaly Detection Techniques and Applications · Smart Grid Security and Resilience
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical, Systems and Automation, Universidad de León, 24071 León, Spain
INCIBE (Spanish National Cybersecurity Institute), 24005 León, Spain
Funding
Universidad de León · INCIBE
References (44)
Show source-provided references
1. Safety and security in cyber-physical systems and internet-of-things systems10.1109/JPROC.2017.2781198 ↗
2. A review of cyber security risk assessment methods for SCADA systems10.1016/j.cose.2015.09.009 ↗
3. Conklin, W.A. (2016, January 5–8). IT vs. OT security: A time to consider a change in CIA to include resilienc. Proceedings of the 2016 49th Hawaii International Conference on System Sciences (HICSS), Koloa, HI, USA.10.1109/HICSS.2016.331 ↗
4. Lee, S., and Shon, T. (2016, January 6–7). Open source intelligence base cyber threat inspection framework for critical infrastructures. Proceedings of the 2016 Future Technologies Conference (FTC), San Francisco, CA, USA.10.1109/FTC.2016.7821730 ↗
5. ShoVAT: Shodan-based vulnerability assessment tool for Internet-facing services10.1002/sec.1262 ↗
6. Liu, Q., Feng, C., Song, Z., Louis, J., and Zhou, J. (2019). Deep Learning Model Comparison for Vision-Based Classification of Full/Empty-Load Trucks in Earthmoving Operations. Appl. Sci., 9.10.3390/app9224871 ↗
7. A new image classification method using CNN transfer learning and web data augmentation10.1016/j.eswa.2017.11.028 ↗
8. Fusión temprana de descriptores extraídos de mapas de prominencia multi-nivel para clasificar imágenes10.4995/riai.2019.10640 ↗
9. Deep convolutional neural networks for image classification: A comprehensive review10.1162/neco_a_00990 ↗
10. Imagenet large scale visual recognition challenge10.1007/s11263-015-0816-y ↗
11. Classifying suspicious content in tor darknet through Semantic Attention Keypoint Filtering10.1016/j.diin.2019.05.004 ↗
12. Boosting image classification through semantic attention filtering strategies10.1016/j.patrec.2018.06.033 ↗
13. Automatically Designing CNN Architectures Using the Genetic Algorithm for Image Classification10.1109/TCYB.2020.2983860 ↗
14. Autonomous deep learning: A genetic DCNN designer for image classification10.1016/j.neucom.2019.10.007 ↗
15. Khan, A., Sohail, A., Zahoora, U., and Qureshi, A.S. (2019). A survey of the recent architectures of deep convolutional neural networks. arXiv.10.1007/s10462-020-09825-6 ↗
16. Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., and Liu, C. (2018, January 4–7). A survey on deep transfer learning. Proceedings of the International Conference on Artificial Neural Networks, Rhodes, Greece.10.1007/978-3-030-01424-7_27 ↗
17. Hussain, M., Bird, J.J., and Faria, D.R. (2018). A study on cnn transfer learning for image classification. UK Workshop on Computational Intelligence, Springer.10.1007/978-3-319-97982-3_16 ↗
18. Xiao, Z., Tan, Y., Liu, X., and Yang, S. (2019). Classification Method of Plug Seedlings Based on Transfer Learning. Appl. Sci., 9.10.3390/app9132725 ↗
19. Zoph, B., Vasudevan, V., Shlens, J., and Le, Q.V. (2018, January 18–22). Learning transferable architectures for scalable image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00907 ↗
20. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
21. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
22. Learning multiple layers of features from tiny images
23. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst., 1097–1105.
24. Zeiler, M.D., and Fergus, R. (2014, January 6–12). Visualizing and understanding convolutional networks. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.10.1007/978-3-319-10590-1_53 ↗
25. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
26. Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv.
27. He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
28. Xie, S., Girshick, R., Dollár, P., Tu, Z., and He, K. (2017, January 21–26). Aggregated residual transformations for deep neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.634 ↗
29. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (July, January 26). Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
30. Hu, J., Shen, L., and Sun, G. (2018, January 18–22). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
31. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv.
32. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18–22). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
33. Howard, A., Sandler, M., Chu, G., Chen, L.C., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., and Vasudevan, V. (November, January 27). Searching for mobilenetv3. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Korea.
34. Tan, M., and Le, Q.V. (2019). Efficientnet: Rethinking model scaling for convolutional neural networks. arXiv.
35. Chollet, F. (2017, January 21–26). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
36. Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A.A. (2017, January 4–9). Inception-v4, inception-resnet and the impact of residual connections on learning. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.10.1609/aaai.v31i1.11231 ↗
37. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20–25). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
38. An analysis of convolutional neural networks for image classification10.1016/j.procs.2018.05.198 ↗
39. Taormina, V., Cascio, D., Abbene, L., and Raso, G. (2020). Performance of Fine-Tuning Convolutional Neural Networks for HEp-2 Image Classification. Appl. Sci., 10.10.3390/app10196940 ↗
40. Bello, I., Zoph, B., Vasudevan, V., and Le, Q.V. (2017, January 6–11). Neural optimizer search with reinforcement learning. Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia.
41. Chollet, F. (2020, November 29). Keras. Available online: https://keras.io.
42. Scikit-learn: Machine Learning in Python
43. Blanco-Medina, P., Alegre, E., Fidalgo, E., Al-Nabki, M., and Chaves, D. (2019). Enhancing text recognition on Tor Darknet images. XL Jornadas Autom., 828–835.
44. Blanco-Medina, P., Fidalgo, E., Alegre, E., and Jáñez Martino, F. (2019, January 16–18). Improving Text Recognition in Tor darknet with Rectification and Super-Resolution techniques. Proceedings of the 9th International Conference on Imaging for Crime Detection and Prevention (ICDP-2019), London, UK.10.1049/cp.2019.1164 ↗