A Fabric Defect Segmentation Model Based on Improved Swin-Unet with Gabor Filter
Source abstract
Abstract
Fabric inspection is critical in fabric manufacturing. Automatic detection of fabric defects in the textile industry has always been an important research field. Previously, manual visual inspection was commonly used; however, there were drawbacks such as high labor costs, slow detection speed, and high error rates. Recently, many defect detection methods based on deep learning have been proposed. However, problems need to be solved in the existing methods, such as detection accuracy and interference of complex background textures. In this paper, we propose an efficient segmentation algorithm that combines traditional operators with deep learning networks to alleviate the existing problems. Specifically, we introduce a Gabor filter into the model, which provides the unique advantage of extracting low-level texture features to solve the problem of texture interference and enable the algorithm to converge quickly in the early stages of training. Furthermore, we design a U-shaped architecture that is not completely symmetrical, making model training easier. Meanwhile, multi-stage result fusion is proposed for precise location of defects. The design of this framework significantly improves the detection accuracy and effectively breaks through the limitations of transformer-based models. Experimental results show that on a dataset with one class, a small amount of data, and complex sample background texture, our method achieved 90.03% and 33.70% in ACC and IoU, respectively, which is almost 10% higher than other previous state of the art models. Experimental results based on three different fabric datasets consistently show that the proposed model has excellent performance and great application potential in the industrial field.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Image Processing Techniques and Applications · Image and Object Detection Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Cyber Science and Engineering, Zhengzhou University, Zhengzhou 450002, China
Institute of Information Technology, Information Engineering University, Zhengzhou 450007, China
Songshan Laboratory, Zhengzhou 450002, China
Funding
National Key R&D Program of China · Natural Science Foundation of China · Key Project of Public Benefit in Henan Province of China · Key Scientific and Technology Project in Henan Province of China · Chinese Scholarship Council
References (42)
Show source-provided references
1. Identification and classification of fabric defects10.21474/IJAR01/1314 ↗
2. FDAS: A knowledge-based framework for analysis of defects in woven textile structures10.1080/00405009208631217 ↗
3. Segmentation-based deep-learning approach for surface-defect detection10.1007/s10845-019-01476-x ↗
4. Mobile-Unet: An efficient convolutional neural network for fabric defect detection10.1177/0040517520928604 ↗
5. Fabric defect segmentation system based on a lightweight GAN for industrial Internet of Things
6. Li, L., Li, Q., Liu, Z., and Xue, L. (2023). Effective Fabric Defect Detection Model for High-Resolution Images. Appl. Sci., 13.10.3390/app131810500 ↗
7. Evaluation of defect detection in textile images using Gabor wavelet based independent component analysis and vector quantized principal component analysis10.1007/978-81-322-1000-9_41 ↗
8. Fabric defect detection based on GLCM and Gabor filter: A comparison10.1016/j.ijleo.2013.05.004 ↗
9. A universal defect detection approach for various types of fabrics based on the Elo-rating algorithm of the integral image10.1177/0040517519840636 ↗
10. Wavelet based methods on patterned fabric defect detection10.1016/j.patcog.2004.07.009 ↗
11. Neural networks for the optical recognition of defects in cloth10.1117/1.601057 ↗
12. Fabric defect detection based on golden image subtraction10.1111/cote.12239 ↗
13. Automated inspection of textile fabrics using textural models10.1109/34.85670 ↗
14. Sequential detection of image defects for patterned fabrics10.1109/ACCESS.2020.3024695 ↗
15. Texture modeling using contourlets and finite mixtures of generalized Gaussian distributions and applications10.1109/TMM.2014.2298832 ↗
16. Zhang, H., Ma, J., Jing, J., and Li, P. (2019). Fabric defect detection using L0 gradient minimization and fuzzy C-means. Appl. Sci., 9.10.3390/app9173506 ↗
17. Fabric defect detection based on saliency histogram features10.1111/coin.12206 ↗
18. A defect detection method for unpatterned fabric based on multidirectional binary patterns and the gray-level co-occurrence matrix10.1177/0040517519879904 ↗
19. Fabric defect detection by Fourier analysis10.1109/28.871274 ↗
20. Automatic band selection for wavelet reconstruction in the application of defect detection10.1016/S0262-8856(03)00003-9 ↗
21. Denim defect detection based on optimal Gabor filter
22. Automatic fabric defect detection using a deep convolutional neural network10.1111/cote.12394 ↗
23. Yue, X., Wang, Q., He, L., Li, Y., and Tang, D. (2022). Research on Tiny Target Detection Technology of Fabric Defects Based on Improved YOLO. Appl. Sci., 12.10.3390/app12136823 ↗
24. Fabric defect segmentation method based on deep learning
25. Improved faster R-CNN for fabric defect detection based on Gabor filter with Genetic Algorithm optimization10.1016/j.compind.2021.103551 ↗
26. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
27. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015: 18th International Conference, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
28. Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N.Y., and Kainz, B. (2018). Attention u-net: Learning where to look for the pancreas. arXiv.
29. Zhou, Z., Rahman Siddiquee, M.M., Tajbakhsh, N., and Liang, J. (2018, January 20). Unet++: A nested u-net architecture for medical image segmentation. Proceedings of the Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, Granada, Spain. Proceedings 4.
30. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv.
31. Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., and Torr, P.H. (2021, January 20–25). Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00681 ↗
32. Li, K., Wang, Y., Zhang, J., Gao, P., Song, G., Liu, Y., Li, H., and Qiao, Y. Uniformer: Unifying convolution and self-attention for visual recognition. IEEE Trans. Pattern Anal. Mach. Intell., 2023.10.1109/TPAMI.2023.3282631 ↗
33. Wang, W., Chen, W., Qiu, Q., Chen, L., Wu, B., Lin, B., He, X., and Liu, W. (2023). Crossformer++: A versatile vision transformer hinging on cross-scale attention. arXiv.10.1109/TPAMI.2023.3341806 ↗
34. Cao, H., Wang, Y., Chen, J., Jiang, D., Zhang, X., Tian, Q., and Wang, M. (2022, January 23–27). Swin-unet: Unet-like pure transformer for medical image segmentation. Proceedings of the Computer Vision–ECCV 2022 Workshops, Tel Aviv, Israel. Proceedings, Part III.10.1007/978-3-031-25066-8_9 ↗
35. Gabor convolutional networks10.1109/TIP.2018.2835143 ↗
36. Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex10.1113/jphysiol.1962.sp006837 ↗
37. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11–18). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00986 ↗
38. Li, X., Sun, X., Meng, Y., Liang, J., Wu, F., and Li, J. (2019). Dice loss for data-imbalanced NLP tasks. arXiv.10.18653/v1/2020.acl-main.45 ↗
39. Lin, T.Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2017, January 22–29). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.324 ↗
40. A public fabric database for defect detection methods and results10.2478/aut-2019-0035 ↗
41. Visitesse (2023, July 19). D Dataset. Available online: https://universe.roboflow.com/visitesse/d-h6tqc.
42. Zhou, H., Chen, Y., Troendle, D., and Jang, B. (2022). One-Class Model for Fabric Defect Detection. arXiv.10.5121/csit.2021.112314 ↗