journal article·2021-07-01Open access

Defect detection in vehicle mirror nonplanar surfaces with multi-scale atrous single-shot detect mechanism

Chuanchang Li, Guohua Cui, Weiwei Zhang, Saixuan Chen, Yinyi Yang

AIP Advances· Volume 11· Issue 7

Abstract

Surface quality inspection is important for vehicle rearview mirrors. Surface quality defects, such as bubbles, particles, cracks, and scratches, may appear during the production process. Traditionally, manual inspection is time-consuming, laborious, low in accuracy, and costly. In recent years, object detectors based on deep learning have been used for defect detection [such as single shot detectors (SSDs)], and object detectors mostly detect the details of small objects at a shallow level. However, the lack of shallow semantic information will lead to inaccuracy. The deep layer has more semantic information, but the deep layer cannot be detected due to the effect of the complete convolutional layer in the convolutional neural network. In this article, we propose an enhanced SSD method to detect micro-defects on the nonplanar surface of vehicle rearview mirrors. We call it the multi-scale atrous single-shot detector (MSASSD). Specifically, we first replace the maximum pool depth layer with an unconscious convolutional layer to expand the receiving field without reducing the size of the input image. Then, we link the shallow layer to the deep layer through the fusion block to form new and rich fusion features for object detection. Finally, we use multi-scale features (including deep features and fusion features) to predict defects. The results show that our MSASSD method can improve the average accuracy of defect detection (about 1.2% compared with the SSD method), while the detection speed is equivalent (low about two frames per second compared to the SSD method).
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Welding Techniques and Residual Stresses · Advanced X-ray and CT Imaging

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Mechanical and Automotive Engineering, Shanghai University of Engineering Science 1 , Shanghai 201620, People’s Republic of China

School of Vehicle and Mobility, Tsinghua University 2 , Beijing 100084, People’s Republic of China

Funding

National Natural Science Foundation of China · Shanghai Sailing Program · Training and Funding Program of Shanghai College Young Teachers

References (34)

Show source-provided references
1. Automatic metallic surface defect detection and recognition with convolutional neural networks10.3390/app8091575 ↗
2. Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types10.1111/mice.12334 ↗
3. Defect inspection for TFT-LCD images based on the low-rank matrix reconstruction10.1016/j.neucom.2014.09.007 ↗
4. Rapid surface defect detection based on singular value decomposition using steel strips as an example10.1063/1.5017589 ↗
5. Deformable patterned fabric defect detection with Fisher criterion-based deep learning10.1109/tase.2016.2520955 ↗
6. Beans quality inspection using correlation-based granulometry10.1016/j.engappai.2015.01.004 ↗
7. SDDNet: Real-time crack segmentation10.1109/TIE.2019.2945265 ↗
8. Solar cell surface defect inspection based on multispectral convolutional neural network10.1007/s10845-018-1458-z ↗
9. Weak scratch detection and defect classification methods for a large-aperture optical element10.1016/j.optcom.2016.10.062 ↗
10. Image segmentation by using thresholding techniques for medical images10.5121/cseij.2016.6101 ↗
11. 1992
12. Multicategory proximal support vector machine classifiers10.1007/s10994-005-0463-6 ↗
13. A generic deep-learning-based approach for automated surface inspection10.1109/tcyb.2017.2668395 ↗
14. Multiscale fully convolutional network with application to industrial inspection
15. Wheel defect detection with machine learning10.1109/tits.2017.2720721 ↗
16. Applied multiresolution analysis to infrared images for defects detection in materials10.1016/j.ndteint.2017.07.014 ↗
17. Research on surface defect detection of ceramic ball based on fringe reflection10.1117/1.oe.56.10.104104 ↗
18. Automatic surface defect detection for mobile phone screen glass based on machine vision10.1016/j.asoc.2016.10.030 ↗
19. A contrast adjustment thresholding method for surface defect detection based on mesoscopy10.1109/tii.2015.2417676 ↗
20. An optical surface inspection and automatic classification technique using the rotated wavelet transform10.1109/tim.2017.2783098 ↗
21. Automatic texture defect detection using gaussian mixture entropy modeling10.1016/j.neucom.2017.02.021 ↗
22. Research of solar cell surface defect detection system based on machine vision10.4028/www.scientific.net/AMR.718-720.532 ↗
23. Deep learning-based crack damage detection using convolutional neural networks10.1111/mice.12263 ↗
24. A new method in wheel hub surface defect detection: Object detection algorithm based on deep learning
25. A high-efficiency fully convolutional networks for pixel-wise surface defect detection10.1109/ACCESS.2019.2894420 ↗
26. You only look once: Unified, real-time object detection
27. SSD: Single shot multibox detector
28. Very deep convolutional neural network based image classification using small training sample size
29. DeepLab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs
30. Research on a surface defect detection algorithm based on MobileNet-SSD10.3390/app8091678 ↗
31. Tiny surface defect inspection of electronic passive components using discrete cosine transform decomposition and cumulative sum techniques10.1016/j.imavis.2007.07.009 ↗
32. The phase only transform for unsupervised surface defect detection
33. Defect detection and classification of galvanized stamping parts based on fully convolution neural network10.1117/12.2303601 ↗
34. See https://hci.iwr.uni-heidelberg.de/node/3616 for Heidelberg Collaboratory for Image Processing.