journal article·2022-11-09Open access

A Semi-Supervised Inspection Approach of Textured Surface Defects under Limited Labeled Samples

Yu He, Xin Wen, Jing Xu

Coatings· Volume 12· Issue 11

Abstract

Defect inspection is a key step in guaranteeing the surface quality of industrial products. Based on deep learning (DL) techniques, related methods are highly effective in defect classification tasks via a supervision process. However, collecting and labeling many defect samples are usually harsh and time-consuming processes, limiting the application of these supervised classifiers on various textured surfaces. This study proposes a semi-supervised framework, based on a generative adversarial network (GAN) and a convolutional neural network (CNN), to classify defects of a textured surface, while a novel label assignment scheme is proposed to integrate unlabeled samples into semi-supervised learning to enhance the overall performance of the system. In this framework, a customized GAN uses limited labeled samples to generate unlabeled ones, while the proposed label assignment scheme makes the generated data follow different label distributions in such a way that they can participate in training with labeled data. Finally, a CNN is proposed for semi-supervised training and the category identification of each defect sample. Experimental results show the effectiveness and robustness of the proposed framework even if original samples are limited. We verify our approach on four different surface defect datasets, achieving consistently competitive performances.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Surface Roughness and Optical Measurements · Non-Destructive Testing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Software Engineering, Shenyang University of Technology, Shenyang 110870, China

Mechanical Engineering, Shenyang University of Technology, Shenyang 110870, China

Funding

SUT Youth Scientific Research Ability Cultivation Project

References (33)

Show source-provided references
1. A Coarse-to-Fine Model for Rail Surface Defect Detection10.1109/TIM.2018.2853958 ↗
2. Wood inspection with non-supervised clustering10.1007/s00138-002-0084-z ↗
3. Kampouris, C., Zafeiriou, S., Ghosh, A., and Malassiotis, S. (2016, January 8–12). Fine-grained material classification using micro-geometry and reflectance. Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.10.1007/978-3-319-46454-1_47 ↗
4. Kahraman, Y., and Durmuşoğlu, A. (2022). Deep learning-based fabric defect detection: A review. Text. Res. J.10.1177/00405175221130773 ↗
5. Kahraman, Y., and Durmuşoğlu, A. (2022). Classification of Defective Fabrics Using Capsule Networks. Appl. Sci., 12.10.3390/app12105285 ↗
6. Audible Sound-Based Intelligent Evaluation for Aluminum Alloy in Robotic Pulsed GTAW Mechanism, Feature Selection, and Defect Detection10.1109/TII.2017.2775218 ↗
7. Ambiguous Surface Defect Image Classification of AMOLED Displays in Smartphones10.1109/TII.2016.2522191 ↗
8. A Simple Guidance Template-Based Defect Detection Method for Strip Steel Surfaces10.1109/TII.2018.2887145 ↗
9. Generalized Completed Local Binary Patterns for Time-Efficient Steel Surface Defect Classi-fication10.1109/TIM.2018.2852918 ↗
10. Classification of surface defects on steel sheet using convolutional neural networks10.17222/mit.2015.335 ↗
11. Automatic Fruit Classification Using Deep Learning for Industrial Ap-plications10.1109/TII.2018.2875149 ↗
12. Deep learning based image recognition for crack and leakage defects of metro shield tunnel10.1016/j.tust.2018.04.002 ↗
13. Verifying edges for visual inspection purposes10.1016/S0167-8655(98)00150-0 ↗
14. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3–6). ImageNet classification with deep convolutional neural networks. Proceedings of the ProceNeural Information Processing Systems (NIPS), Lake Tahoe, NV, USA.
15. Simonyan, K., and Zisserman, A. (2015, January 7–9). Very deep convolutional networks for large-scale image recognition. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA.
16. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27–30). Rethinking the Inception Architecture for Computer Vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.308 ↗
17. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
18. A Generic Deep-Learning-Based Approach for Automated Surface Inspection10.1109/TCYB.2017.2668395 ↗
19. Transfer-Learning-Based Online Mura Defect Classification10.1109/TSM.2017.2777499 ↗
20. Natarajan, V., Hung, T.-Y., Vaikundam, S., and Chia, L.-T. (2017, January 22–25). Convolutional networks for voting-based anomaly classification in metal surface inspection. Proceedings of the IEEE International Conference on Industrial Technology (ICIT), Toronto, ON, Canada.10.1109/ICIT.2017.7915495 ↗
21. Deep learning10.1038/nature14539 ↗
22. Liu, C., Su, K., Yang, L., Li, J., and Guo, J. (2022). Detection of Complex Features of Car Body-in-White under Limited Number of Samples Using Self-Supervised Learning. Coatings, 12.10.3390/coatings12050614 ↗
23. Papandreou, G., Chen, L.-C., Murphy, K.P., and Yuille, A.L. (2015, January 13–16). Weakly-and semi-supervised learning of a deep convolutional network for semantic image segmentation. Proceedings of the International Conference on Computer Vision. (ICCV), Santiago, Chile.10.1109/ICCV.2015.203 ↗
24. Song, K., Wang, J., Bao, Y., Huang, L., and Yan, Y. (2022). A Novel Visible-Depth-Thermal Image Dataset of Salient Object Detection for Robotic Visual Perception. IEEE/ASME Trans. Mechatron., 1–12.
25. Semi-Supervised Deep Learning Using Pseudo Labels for Hyperspectral Image Classification10.1109/TIP.2017.2772836 ↗
26. Odena, A. (2015, January 6–11). Semi-Supervised Learning with Generative Adversarial Networks. Proceedings of the International Conference on Machine Learning. (ICML), New York, NY, USA.
27. Surface defect classification of steels with a new semi-supervised learning method10.1016/j.optlaseng.2019.01.011 ↗
28. Larsen, A.B.L., Kaae, S.S., and Winther, O. (2016, January 19–24). Autoencoding beyond pixels using a learned similarity metric. Proceedings of the International Conference on Machine Learning. (ICML), New York, NY, USA.
29. Alec, R., Luke, M., and Soumith, C. (2015). Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv.
30. Deep Convolutional Computation Model for Feature Learning on Big Data in Internet of Things10.1109/TII.2017.2739340 ↗
31. Kingma, P.D., and Ba, J. (2015, January 7–9). Adam: A Method for Stochastic Optimization. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA.
32. A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects10.1016/j.apsusc.2013.09.002 ↗
33. Huang, Y., Qiu, C., and Guo, Y. (2018, January 18–22). Saliency of magnetic tile surface defects. Proceedings of the 14th IEEE International Conference on Auto-Mation and Engineering, Munich, Germany.