journal article·2019-12-12Open access

Steel Surface Defect Diagnostics Using Deep Convolutional Neural Network and Class Activation Map

Soo Young Lee, Bayu Adhi Tama, Seok Jun Moon, Seungchul Lee

Applied Sciences· Volume 9· Issue 24

Abstract

Steel defect diagnostics is considerably important for a steel-manufacturing industry as it is strongly related to the product quality and production efficiency. Product quality control suffers from a real-time diagnostic capability since it is less-automatic and is not reliable in detecting steel surface defects. In this study, we propose a relatively new approach for diagnosing steel defects using a deep structured neural network, e.g., convolutional neural network (CNN) with class activation maps. Rather than using a simple deep learning algorithm for the classification task, we extend the CNN diagnostic model for being used to analyze the localized defect regions within the images to support a real-time visual decision-making process. Based on the experimental results, the proposed approach achieves a near-perfect detection performance at 99.44% and 0.99 concerning the accuracy and F-1 score metric, respectively. The results are better than other shallow machine learning algorithms, i.e., support vector machine and logistic regression under the same validation technique.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Surface Roughness and Optical Measurements · Non-Destructive Testing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Mechanical Engineering, Pohang University of Science and Technology (POSTECH), Pohang 37673, Korea

Department of System Dynamics, Korea Institute of Machinery and Materials, Daejeon 34103, Korea

Funding

Ministry of Trade, Industry and Energy · Korea Institute for Advancement of Technology · Institute for Information and Communications Technology Promotion

References (29)

Show source-provided references
1. Temperature Control Optimization in a Steel-Making Continuous Casting Process Using Multimodal Deep Learning Approach10.1002/srin.201900321 ↗
2. A cost-effective and automatic surface defect inspection system for hot-rolled flat steel10.1016/j.rcim.2015.09.008 ↗
3. Automatic defect detection on hot-rolled flat steel products10.1109/TIM.2012.2218677 ↗
4. He, Y., Song, K., Meng, Q., and Yan, Y. (2019). An End-to-end Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features. IEEE Trans. Instrum. Meas.10.1109/TIM.2019.2915404 ↗
5. A Neural Network Model for Material Degradation Detection and Diagnosis Using Microscopic Images10.1109/ACCESS.2019.2927162 ↗
6. Steel surface defect detection using a new Haar–Weibull-variance model in unsupervised manner10.1109/TIM.2017.2712838 ↗
7. A New Ensemble Approach based on Deep Convolutional Neural Networks for Steel Surface Defect classification10.1016/j.procir.2018.03.264 ↗
8. A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects10.1016/j.apsusc.2013.09.002 ↗
9. Jia, H., Murphey, Y.L., Shi, J., and Chang, T.S. (2004, January 26). An intelligent real-time vision system for surface defect detection. Proceedings of the 17th International Conference on Pattern Recognition, ICPR 2004, Cambridge, UK.
10. Steel surface defects detection and classification using SIFT and voting strategy
11. Machine learning-based imaging system for surface defect inspection10.1007/s40684-016-0039-x ↗
12. An End-to-End Steel Strip Surface Defects Recognition System Based on Convolutional Neural Networks10.1002/srin.201600068 ↗
13. A fast and robust convolutional neural network-based defect detection model in product quality control10.1007/s00170-017-0882-0 ↗
14. Masci, J., Meier, U., Ciresan, D., Schmidhuber, J., and Fricout, G. (2012, January 10–15). Steel defect classification with max-pooling convolutional neural networks. Proceedings of the 2012 International Joint Conference on Neural Networks (IJCNN), Brisbane, QLD, Australia.10.1109/IJCNN.2012.6252468 ↗
15. Defect detection for corner cracks in steel billets using a wavelet reconstruction method10.1364/JOSAA.31.000227 ↗
16. An evolutionary classifier for steel surface defects with small sample set10.1186/s13640-017-0197-y ↗
17. A semi-supervised convolutional neural network-based method for steel surface defect recognition10.1016/j.rcim.2019.101825 ↗
18. Textural features for image classification10.1109/TSMC.1973.4309314 ↗
19. An identification method of malignant and benign liver tumors from ultrasonography based on GLCM texture features and fuzzy SVM10.1016/j.eswa.2010.02.067 ↗
20. Automatic characterization of fracture surfaces of AISI 304LN stainless steel using image texture analysis10.1016/j.measurement.2012.01.026 ↗
21. Okarma, K., and Fastowicz, J. (September, January 29). No-reference quality assessment of 3D prints based on the GLCM analysis. Proceedings of the 2016 21st International Conference on Methods and Models in Automation and Robotics (MMAR), Miedzyzdroje, Poland.10.1109/MMAR.2016.7575237 ↗
22. A vision system for surface roughness characterization using the gray level co-occurrence matrix10.1016/j.ndteint.2004.03.004 ↗
23. Histograms of Oriented Gradients for Human Detection
24. Bertozzi, M., Broggi, A., Del Rose, M., Felisa, M., Rakotomamonjy, A., and Suard, F. (October, January 30). A pedestrian detector using histograms of oriented gradients and a support vector machine classifier. Proceedings of the 2007 IEEE Intelligent Transportation Systems Conference, Seattle, WA, USA.10.1109/ITSC.2007.4357692 ↗
25. Efficient HOG human detection10.1016/j.sigpro.2010.08.010 ↗
26. Convolutional networks for images, speech, and time series
27. Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (2016, January 27–30). Learning Deep Features for Discriminative Localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.319 ↗
28. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
29. Ioffe, S., and Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv.