Performance Evaluation and Misclassification Distribution Analysis of Pre-Trained Lightweight CNN Models for Hot-Rolled Steel Strip Surface Defect Classification Under Degraded Imaging Conditions
Source abstract
Abstract
Surface defects in hot-rolled steel strip alter the material’s properties and degrade its overall quality. Especially in real production environments, due to time sensitivity, lightweight Convolutional Neural Network models are suitable for inspecting these defects. However, in real-time applications, the acquired images are subjected to various degradations, including noise, motion blur, and non-uniform illumination. The performance of lightweight CNN models on degraded images is crucial, as improved performance on such images reduces the reliance on preprocessing techniques for image enhancement. Thus, this study focuses on analyzing pre-trained lightweight CNN models for surface defect classification in hot-rolled steel strips under degradation conditions. Six state-of-the-art lightweight CNN architectures—MobileNet-V1, MobileNet-V2, MobileNet-V3, NasNetMobile, ShuffleNet V2 and EfficientNet-B0—are evaluated. Performance is assessed using standard classification metrics. The results indicate that MobileNet-V1 is the most effective model among those used in this study. Additionally, a new performance metric is proposed in this study. Using this metric, the misclassification distribution is evaluated for concentration versus homogeneity, thereby facilitating the identification of areas for model improvement. The proposed metric demonstrates that the MobileNet-V1 exhibits good performance under both low and high degradation conditions in terms of misclassification robustness.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Non-Destructive Testing Techniques · Welding Techniques and Residual Stresses
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical and Electronics Engineering, Faculty of Engineering and Natural Sciences, Hitit University, Corum 19030, Turkey
References (29)
Show source-provided references
1. A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects10.1016/j.apsusc.2013.09.002 ↗
2. A deep-learning-based approach for fast and robust steel surface defects classification10.1016/j.optlaseng.2019.05.005 ↗
3. Review of vision-based steel surface inspection systems10.1186/1687-5281-2014-50 ↗
4. A comprehensive review of convolutional neural networks for defect detection in industrial applications10.1109/ACCESS.2024.3425166 ↗
5. Wen, X., Shan, J., He, Y., and Song, K. (2022). Steel surface defect recognition: A survey. Coatings, 13.10.3390/coatings13010017 ↗
6. An end-to-end steel strip surface defects recognition system based on convolutional neural networks10.1002/srin.201600068 ↗
7. LE-YOLOv5: A lightweight and efficient neural network for steel surface defect detection10.1109/ACCESS.2024.3519161 ↗
8. Steel surface defect detection based on the lightweight improved RT-DETR algorithm10.1007/s11554-024-01611-9 ↗
9. A survey of real-time surface defect inspection methods based on deep learning10.1007/s10462-023-10475-7 ↗
10. CNN-based hot-rolled steel strip surface defects classification: A comparative study between different pre-trained CNN models10.1007/s00170-024-13341-0 ↗
11. Wi, T., Yang, M., Park, S., and Jeong, J. (2024). D2-SPDM: Faster R-CNN-based defect detection and surface pixel defect mapping with label enhancement in steel manufacturing processes. Appl. Sci., 14.10.3390/app14219836 ↗
12. Steel surface defect detection and segmentation using deep neural networks10.1016/j.rineng.2025.103972 ↗
13. Transfer learning-based approach using new convolutional neural network classifier for steel surface defects classification
14. Jeong, M., Yang, M., and Jeong, J. (2024). Hybrid-DC: A hybrid framework using ResNet-50 and vision transformer for steel surface defect classification in the rolling process. Electronics, 13.10.3390/electronics13224467 ↗
15. Li, Z., Tian, X., Liu, X., Liu, Y., and Shi, X. (2022). A two-stage industrial defect detection framework based on improved-yolov5 and optimized-inception-resnetv2 models. Appl. Sci., 12.10.3390/app12020834 ↗
16. Automated visual defect classification for flat steel surface: A survey10.1109/TIM.2020.3030167 ↗
17. Fabric defect detection based on a deep convolutional neural network using a two-stage strategy10.1177/0040517520935984 ↗
18. A vision-based fusion method for defect detection of milling cutter spiral cutting edge10.1016/j.measurement.2021.109248 ↗
19. Chen, Z., Wang, W., Wu, Q., Lu, Y., Zhou, L., and Chen, H. (2023). A Denoising Method for Multi-Noise on Steel Surface Detection. Appl. Sci., 13.10.3390/app131810471 ↗
20. Methods for image denoising using convolutional neural network: A review10.1007/s40747-021-00428-4 ↗
21. Distributed defect recognition on steel surfaces using an improved random forest algorithm with optimal multi-feature-set fusion10.1007/s11042-017-5238-0 ↗
22. Tasdizen, T., Jurrus, E., and Whitaker, R.T. (2008, January 6–10). Non-uniform illumination correction in transmission electron microscopy. Proceedings of the MICCAI Workshop on Microscopic Image Analysis with Applications in Biology, New York, NY, USA.
23. Prediction of micro-hardness in thread rolling of St37 by convolutional neural networks and transfer learning10.1007/s00170-022-10355-4 ↗
24. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv.
25. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18–23). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
26. Howard, A., Sandler, M., Chu, G., Chen, L.C., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., and Vasudevan, V. (November, January 27). Searching for mobilenetv3. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
27. Zoph, B., Vasudevan, V., Shlens, J., and Le, Q.V. (2018, January 18–23). Learning transferable architectures for scalable image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00907 ↗
28. Ma, N., Zhang, X., Zheng, H.T., and Sun, J. (2018, January 8–14). Shufflenet v2: Practical guidelines for efficient cnn architecture design. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01264-9_8 ↗
29. Tan, M., and Le, Q. (2019, January 9–15). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning PMLR, Long Beach, CA, USA.