journal article·2020-12-30Open access

An Unsupervised Generative Adversarial Network-Based Method for Defect Inspection of Texture Surfaces

Jichun Wang, Guodong Yi, Shuyou Zhang, Yang Wang

Applied Sciences· Volume 11· Issue 1

Abstract

Recently, deep learning-based defect inspection methods have begun to receive more attention—from both researchers and the industrial community—due to their powerful representation and learning capabilities. These methods, however, require a large number of samples and manual annotation to achieve an acceptable detection rate. In this paper, we propose an unsupervised method of detecting and locating defects on patterned texture surface images which, in the training phase, needs only a moderate number of defect-free samples. An extended deep convolutional generative adversarial network (DCGAN) is utilized to reconstruct input image patches; the resulting residual map can be used to realize the initial segmentation defects. To further improve the accuracy of defect segmentation, a submodule termed “local difference analysis” (LDA) is embedded into the overall module to eliminate false positives. We conduct comparative experiments on a series of datasets and the final results verify the effectiveness of the proposed method.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Integrated Circuits and Semiconductor Failure Analysis · Non-Destructive Testing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

State Key Laboratory of Fluid Power & Mechatronic Systems, Zhejiang University, Hangzhou 310027, China

Funding

National Natural Science Foundation of China · Science and Technology Program of Beijing

References (37)

Show source-provided references
1. Czimmermann, T., Ciuti, G., Milazzo, M., Chiurazzi, M., Roccella, S., Oddo, C.M., and Dario, P. (2020). Visual-Based Defect Detection and Classification Approaches for Industrial Applications—A survey. Sensors, 20.10.3390/s20051459 ↗
2. Automated fabric defect detection—A review10.1016/j.imavis.2011.02.002 ↗
3. An improved Otsu method using the weighted object variance for defect detection10.1016/j.apsusc.2015.05.033 ↗
4. Automatic thresholding for defect detection by background histogram mode extents10.1016/j.jmsy.2015.09.004 ↗
5. Applying fourier and associated transforms to pattern characterization in textiles10.1177/004051759006000404 ↗
6. Statistical and structural approaches to texture10.1109/PROC.1979.11328 ↗
7. Textural Features for Image Classification10.1109/TSMC.1973.4309314 ↗
8. A comparative study of texture measures with classification based on featured distributions10.1016/0031-3203(95)00067-4 ↗
9. Detection of surface crack defects on ferrite magnetic tile10.1016/j.ndteint.2013.10.006 ↗
10. Multiscale image quality measures for defect detection in thin films10.1007/s00170-014-6758-7 ↗
11. Neural networks for the optical recognition of defects in cloth10.1117/1.601057 ↗
12. Discriminative fabric defect detection using adaptive wavelets10.1117/1.1517290 ↗
13. Karayiannis, Y.A., Stojanovic, R., Mitropoulos, P., Koulamas, C., Stouraitis, T., Koubias, S., and Papadopoulos, G. (1999, January 5–8). Defect detection and classification on web textile fabric using multiresolution decomposition and neural networks. Proceedings of the IEEE International Conference on Electronics, Circuits and Systems, Pafos, Cyprus.
14. Ogata, N., Fukuma, S., Nishikado, H., Shirosaki, A., Takagi, S., and Sakurai, T. (2005, January 13–16). An accurate inspection of PDP-mesh cloth using Gabor filter. Proceedings of the International Symposium on Intelligent Signal Processing and Communication Systems, Hong Kong, China.10.1109/ISPACS.2005.1595347 ↗
15. An automated inspection system for textile fabrics based on Gabor filters10.1016/j.rcim.2007.02.019 ↗
16. Sari-Sarraf, H., and Goddard, J.S. (1999, January 5–7). Vision system for on-loom fabric inspection. Proceedings of the Textile, Fiber & Film Industry Technical Conference, Charlotte, NC, USA.
17. Sari-Sarraf, H., and Goddard, J.S. (1998, January 25–25). Robust defect segmentation in woven fabrics. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Santa Barbara, CA, USA.
18. Serafim, A.L. (September, January 30). Segmentation of natural images based on multiresolution pyramids linking of the parameters of an autoregressive rotation invariant model. Application to leather defects detection. Proceedings of the International Conference on Pattern Recognition, Conference C: Image, Speech & Signal Analysis, The Hague, The Netherlands.
19. Serafim, A.F.L. (November, January 28). Multiresolution pyramids for segmentation of natural images based on autoregressive models: Application to calf leather classification. Proceedings of the International Conference on Industrial Electronics, Control and Instrumentation, Kobe, Japan.
20. Unsupervised textured image segmentation using 2-D quarter plane autoregressive model with four prediction supports10.1016/j.patrec.2004.10.002 ↗
21. Ozdemir, S., and Ercil, A. (1996, January 18–21). Markov random fields and Karhunen-Loeve transforms for defect inspection of textile products. Proceedings of the IEEE Conference on Emerging Technologies and Factory Automation, Kauai, HI, USA.
22. Automated inspection of textile fabrics using textural models10.1109/34.85670 ↗
23. Moradi, S., and Zayed, T. (2017). Real-time defect detection in sewer closed circuit television inspection videos. Pipelines 2017, ASCE.10.1061/9780784480885.027 ↗
24. Psuj, G. (2018). Multi-Sensor Data Integration Using Deep Learning for Characterization of Defects in Steel Elements. Sensors, 18.10.3390/s18010292 ↗
25. Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection10.1016/j.conbuildmat.2017.09.110 ↗
26. Automated defect inspection of LED chip using deep convolutional neural network10.1007/s10845-018-1415-x ↗
27. Segmentation-based deep-learning approach for surface-defect detection10.1007/s10845-019-01476-x ↗
28. A fast and robust convolutional neural network-based defect detection model in product quality control10.1007/s00170-017-0882-0 ↗
29. A Generic Deep-Learning-Based Approach for Automated Surface Inspection10.1109/TCYB.2017.2668395 ↗
30. An Unsupervised-Learning-Based Approach for Automated Defect Inspection on Textured Surfaces10.1109/TIM.2018.2795178 ↗
31. Schlegl, T., Seebck, P., Waldstein, S.M., Schmidt-Erfurth, U., and Langs, G. (2017, January 25–30). Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery. Proceedings of the International Conference on Information Processing in Medical Imaging, Boone, NC, USA.10.1007/978-3-319-59050-9_12 ↗
32. Unsupervised fabric defect detection based on a deep convolutional generative adversarial network10.1177/0040517519862880 ↗
33. (2020, December 18). TILDA Textile Texture Database. Available online: https://lmb.informatik.uni-freiburg.de/resources/datasets/tilda.en.html.
34. Patterned Fabric Inspection and Visualization by the Method of Image Decomposition10.1109/TASE.2014.2314240 ↗
35. Regularity Analysis for Patterned Texture Inspection10.1109/TASE.2008.917140 ↗
36. Bergmann, P., Fauser, M., Sattlegger, D., and Steger, C. (2019, January 15–20). MVTec AD—A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00982 ↗
37. Aiger, D., and Talbot, H. (2010). The phase only transform for unsupervised surface defect detection. Emerging Topics in Computer Vision and Its Applications, World Scientific Pub. Co.10.1109/CVPR.2010.5540198 ↗