journal article·2018-09-06Open access

Automatic Metallic Surface Defect Detection and Recognition with Convolutional Neural Networks

Xian Tao, Dapeng Zhang, Wenzhi Ma, Xilong Liu, De Xu

Applied Sciences· Volume 8· Issue 9

Abstract

Automatic metallic surface defect inspection has received increased attention in relation to the quality control of industrial products. Metallic defect detection is usually performed against complex industrial scenarios, presenting an interesting but challenging problem. Traditional methods are based on image processing or shallow machine learning techniques, but these can only detect defects under specific detection conditions, such as obvious defect contours with strong contrast and low noise, at certain scales, or under specific illumination conditions. This paper discusses the automatic detection of metallic defects with a twofold procedure that accurately localizes and classifies defects appearing in input images captured from real industrial environments. A novel cascaded autoencoder (CASAE) architecture is designed for segmenting and localizing defects. The cascading network transforms the input defect image into a pixel-wise prediction mask based on semantic segmentation. The defect regions of segmented results are classified into their specific classes via a compact convolutional neural network (CNN). Metallic defects under various conditions can be successfully detected using an industrial dataset. The experimental results demonstrate that this method meets the robustness and accuracy requirements for metallic defect detection. Meanwhile, it can also be extended to other detection applications.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Non-Destructive Testing Techniques · Surface Roughness and Optical Measurements

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Research Center of Precision Sensing and Control, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China

School of Mechanical Electronic and Information Engineering, China University of Mining and Technology, Beijing 100083, China

Funding

National Natural Science Foundation of China

References (47)

Show source-provided references
1. Kim, S., Kim, W., Noh, Y.K., and Park, F.C. (2017, January 14–19). Transfer learning for automated optical inspection. Proceedings of the International Joint Conference on Neural Networks, Anchorage, AK, USA.10.1109/IJCNN.2017.7966162 ↗
2. A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects10.1016/j.apsusc.2013.09.002 ↗
3. Wu, Y., Qin, Y., Wang, Z., and Jia, L. (2018). A UAV-based visual inspection method for rail surface defects. Appl. Sci., 8.10.3390/app8071028 ↗
4. Defect inspection for TFT-LCD images based on the low-rank matrix reconstruction10.1016/j.neucom.2014.09.007 ↗
5. Scale insensitive and focus driven mobile screen defect detection in industry10.1016/j.neucom.2018.03.013 ↗
6. Deformable patterned fabric defect detection with Fisher criterion-based deep learning10.1109/TASE.2016.2520955 ↗
7. Feature selection for surface defect classification of extruded aluminum profiles10.1007/s00170-015-7514-3 ↗
8. Deep multitask learning for railway track inspection10.1109/TITS.2016.2568758 ↗
9. Beans quality inspection using correlation-based granulometry10.1016/j.engappai.2015.01.004 ↗
10. Weak scratch detection and defect classification methods for a large-aperture optical element10.1016/j.optcom.2016.10.062 ↗
11. A generic deep-learning-based approach for automated surface inspection10.1109/TCYB.2017.2668395 ↗
12. Fault diagnosis of photovoltaic modules through image processing and Canny edge detection on field thermographic measurements10.1080/14786451.2013.826223 ↗
13. Rail defect detection and classification with real time image processing technique
14. Automatic surface defect detection for mobile phone screen glass based on machine vision10.1016/j.asoc.2016.10.030 ↗
15. Fabric defect detection using morphological filters10.1016/j.imavis.2009.03.007 ↗
16. Quantitative surface crack evaluation based on eddy current pulsed thermography10.1109/JSEN.2016.2625815 ↗
17. An improved Otsu method using the weighted object variance for defect detection10.1016/j.apsusc.2015.05.033 ↗
18. A contrast adjustment thresholding method for surface defect detection based on mesoscopy10.1109/TII.2015.2417676 ↗
19. A rapid automatic brain tumor detection method for MRI images using modified minimum error thresholding technique
20. Calculation of flexible printed circuit boards (FPC) global and local defect detection based on computer vision10.1108/CW-07-2014-0027 ↗
21. Saliency-based defect detection in industrial images by using phase spectrum10.1109/TII.2014.2359416 ↗
22. An Optical Surface Inspection and Automatic Classification Technique Using the Rotated Wavelet Transform10.1109/TIM.2017.2783098 ↗
23. Automated defect detection in textured surfaces using optimal elliptical Gabor filters10.1016/j.ijleo.2015.04.017 ↗
24. Automatic texture defect detection using Gaussian mixture entropy modeling10.1016/j.neucom.2017.02.021 ↗
25. Shumin, D., Zhoufeng, L., and Chunlei, L. (2011, January 26–28). Adaboost learning for fabric defect detection based on hog and SVM. Proceedings of the International Conference on Multimedia Technology, Hangzhou, China.
26. Deep normalized convolutional neural network for imbalanced fault classification of machinery and its understanding via visualization10.1016/j.ymssp.2018.03.025 ↗
27. Acoustic based fault diagnosis of three-phase induction motor10.1016/j.apacoust.2018.03.010 ↗
28. Neural networks in mining sciences—General overview and some representative examples
29. Design of the model for the on-line control of the AWJ technology based on neural networks
30. Masci, J., Meier, U., Fricout, G., and Schmidhuber, J. (2013, January 4–9). Multi-scale pyramidal pooling network for generic steel defect classification. Proceedings of the International Joint Conference on Neural Networks, Dallas, TX, USA.10.1109/IJCNN.2013.6706920 ↗
31. Natarajan, V., Hung, T.Y., Vaikundam, S., and Chia, L.T. (2017, January 22–25). Convolutional networks for voting-based anomaly classification in metal surface inspection. Proceedings of the IEEE International Conference on Industrial Technology, Toronto, ON, Canada.10.1109/ICIT.2017.7915495 ↗
32. A fast and robust convolutional neural network-based defect detection model in product quality control10.1007/s00170-017-0882-0 ↗
33. Autonomous structural visual inspection using region—Based deep learning for detecting multiple damage types10.1111/mice.12334 ↗
34. Automated defect inspection of LED chip using deep convolutional neural network
35. Automatic defect detection of fasteners on the catenary support device using deep convolutional neural network10.1109/TIM.2017.2775345 ↗
36. Xiao, Z., Leng, Y., Geng, L., and Xi, J. (2017, January 14–16). Defect detection and classification of galvanized stamping parts based on fully convolution neural network. Proceedings of the Ninth International Conference on Graphic and Image Processing (ICGIP 2017), Qingdao, China.
37. A survey of deep neural network architectures and their applications10.1016/j.neucom.2016.12.038 ↗
38. Karen, S., and Andrew, Z. (2015, January 7–9). Very deep convolutional networks for large-scale image recognition. Proceedings of the International Conference On Representation Learning (ICRL 2015), San Diego, CA, USA.
39. Islam, M.A., Rochan, M., Bruce, N.D., and Wang, Y. (2017, January 21–26). Gated feedback refinement network for dense image labeling. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.518 ↗
40. Chen, L.C., Papandreou, G., Schroff, F., and Adam, H. (2018, August 20). Rethinking Atrous Convolution for Semantic Image Segmentation. Available online: https://pdfs.semanticscholar.org/efb3/fec61a1433609635f2bd21a18f8b6ef47541.pdf.
41. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 8–10). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
42. He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
43. Image deformation using moving least squares10.1145/1141911.1141920 ↗
44. TensorFlow: A system for large-scale machine learning
45. Consiglio Nazionale Delle Ricerche (2017, December 03). Matlab Tool for Analyzing SEM Images of Electrospun Material. Available online: http://www.mi.imati.cnr.it/ettore/NanoTWICE/.
46. Defect detection in SEM images of nanofibrous materials10.1109/TII.2016.2641472 ↗
47. (2018, February 27). DAGM 2007 Datasets. Available online: https://hci.iwr.uni-heidelberg.de/node/3616.