journal article·2021-09-25Open access

Copper Strip Surface Defect Detection Model Based on Deep Convolutional Neural Network

Yanghuan Xu, Dongcheng Wang, Bowei Duan, Huaxin Yu, Hongmin Liu

Applied Sciences· Volume 11· Issue 19

Abstract

Surface defect automatic detection has great significance for copper strip production. The traditional machine vision for surface defect automatic detection of copper strip needs artificial feature design, which has a long cycle, and poor ability of versatility and robustness. However, deep learning can effectively solve these problems. Therefore, based on the deep convolution neural network and the transfer learning strategy, an intelligent recognition model of surface defects of copper strip is established in this paper. Firstly, the defects were classified in accordance with the mechanism and morphology, and the surface defect dataset of copper strip was established by comprehensively adopting image acquisition and image augmentation. Then, a two-class discrimination model was established to achieve the accurate discrimination of perfect and defect images. On this basis, four CNN models were adopted for the recognition of defect images. Among these models, the EfficientNet model through transfer learning strategy had the best comprehensive performance with a recognition accuracy rate of 93.05%. Finally, the interpretability and deficiency of the model were analysed by the class activation map and confusion matrix, which point toward the direction of further optimization for future research.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Surface Roughness and Optical Measurements · Manufacturing Process and Optimization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

National Engineering Research Center for Equipment and Technology of Cold Rolling Strip, Yanshan University, Qinhuangdao 066004, China

State Key Laboratory of Metastable Materials Science and Technology, Yanshan University, Qinhuangdao 066004, China

Funding

National Natural Science Foundation of China · High-end Talents and "Giant Plan" Innovation Team of Hebei Province

References (36)

Show source-provided references
1. Present situation of Chinese copper processing industry and its development trend
2. Influence factors analysis for the next 20 years of Chinese copper resources demand
3. Surface quality control and technical actuality of copper and copper alloy strip
4. Discussion on surface quality control of copper sheet and strip
5. Song, Q. (2012). Applications of machine vision to the quality test of copper strip surfaces. Shanghai Nonferrous Met., 77–80.
6. An algorithm of detecting surface defects of copper plating based on dynamic threshold
7. Techniques of machine vision applied in detection of copper strip surface’s defects
8. Surface defects inspection of copper strips based on vision bionic
9. Li, J.H. (2019). Research on Key Technology of Surface Defect Detection in Aluminum/Copper Strip. [Master’s Thesis, Henan University of Science and Technology].
10. Meng, F.M. (2019). Development of Copper Strip Defect Online Detection System Based on ARM and DSP. [Master’s Thesis, China Jiliang University].
11. Inspection of surface defects in copper strip using multivariate statistical approach and SVM. Inter10.1504/IJCAT.2012.045840 ↗
12. Industrial artificial intelligence in industry 4.0-systematic review, challenges and outlook10.1109/ACCESS.2020.3042874 ↗
13. A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects10.1016/j.apsusc.2013.09.002 ↗
14. An end-to-end steel surface defect detection approach via fusing multiple hierarchical features
15. Saiz, F.A., Serrano, I., Barandiaran, I., and Sanchez, J.R. (2018, January 25–27). A robust and fast deep learning-based method for defect classification in steel surfaces. Proceedings of the 9th International Conference on Intelligent Systems (IS), Funchal, Portugal.10.1109/IS.2018.8710501 ↗
16. Aluminum product surface defect detection method based on improved Faster RCNN
17. Zheng, X., and Huang, D.J. (2020). Defect detection on aluminum surfaces based on deep learning. J. East. China Norm. Univ. (Nat. Sci.), 105–114.
18. End-to-end aluminum strip surface defects detection and recognition method based on ViBe
19. A semi-supervised convolutional neural network-based method for steel surface defect recognition10.1016/j.rcim.2019.101825 ↗
20. Semi-supervised defect classification of steel surface based on multi-training and generative adversarial network10.1016/j.optlaseng.2019.06.020 ↗
21. Fast simulation of additive generalized Gaussian noise environments10.1109/LCOMM.2020.2989246 ↗
22. A two-stage filter for high density salt and pepper denoising10.1007/s11042-020-08887-6 ↗
23. Lee, S.Y., Tama, B.A., Moon, S.J., and Lee, S. (2019). Steel surface defect diagnostics using deep convolutional neural network and class activation map. Appl. Sci., 9.10.3390/app9245449 ↗
24. Wang, D.C., Xu, Y.H., Duan, B.W., Wang, Y.M., Song, M.M., Yu, H.X., and Liu, H.M. (2021). Intelligent recognition model of hot rolling strip edge defects based on deep learning. Metals, 11.10.3390/met11020223 ↗
25. Piltan, F., Prosvirin, A.E., Jeong, I., Im, K., and Kim, J.M. (2019). Rolling-element bearing fault diagnosis using advanced machine learning-based observer. Appl. Sci., 9.10.3390/app9245404 ↗
26. Optimization design of RBF-ARX model and application research on flatness control system10.1002/oca.2240 ↗
27. He, K.M., Zhang, X.Y., Ren, S.Q., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR.2016.90 ↗
28. Huang, G., Liu, Z., Laurens, V.D.M., and Weinberger, K.Q. (2017, January 21–26). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
29. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L. (2018, January 18–23). MobileNetV2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
30. Classification of remote sensing images using EfficientNet-B3 CNN Model with Attention10.1109/ACCESS.2021.3051085 ↗
31. Automated fruit recognition using EfficientNet and MixNet10.1016/j.compag.2020.105326 ↗
32. Tan, M.X., and Le, Q.V. (2019). Efficientnet: Rethinking model scaling for convolutional neural networks. arXiv.
33. Bazi, Y., Al Rahhal, M.M., Alhichri, H., and Alajlan, N. (2019). Simple yet effective fine-tuning of deep CNNs using an auxiliary classification loss for remote sensing scene classification. Remote Sens., 11.10.3390/rs11242908 ↗
34. Infrared handprint classification using deep convolution neural network10.1007/s11063-021-10429-6 ↗
35. Lyu, Y.Q., Jiang, J., Zhang, K., Hua, Y.L., and Cheng, M. (November, January 27). Factorizing and reconstituting large-kernel MBConv for lightweight face recognition. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), Seoul, Korea.10.1109/ICCVW.2019.00329 ↗
36. Gao, F., Li, Z., Xiao, G., Yuan, X.Y., and Han, Z.G. (2012, January 16–18). An online inspection system of surface defects for copper strip based on computer vision. Proceedings of the 2012 5th International Congress on Image and Signal Processing (CISP), Chongqing, China.10.1109/CISP.2012.6469775 ↗