journal article·2023-08

QA-USTNet: Yarn-dyed fabric defect detection via U-shaped Swin Transformer Network based on Quadtree Attention

Hongwei Zhang, Wenbo Xiong, Shuai Lu, Mengdan Chen, Le Yao

Textile Research Journal· Volume 93· Issue 15-16
Publisher page

Abstract

The detection and location of yarn-dyed fabric defects is a crucial and challenging problem in actual production scenarios. Recently, unsupervised fabric defect detection methods based on convolutional neural networks have attracted more attention. However, the convolutional neural networks often neglect to model the global receptive field of images, which further influence the defect detection ability of the model. In this article, we propose a U-shaped Swin Transformer network based on Quadtree attention framework for unsupervised yarn-dyed fabric defect detection. The method via U-shaped network based on Swin Transformer, the Swin Transformer adopts local attention to effectively learn features, and the U-shaped network realizes pixel-level reconstruction of images. The Quadtree attention is used to effectively capture the global features of the image, and model the global receptive field, and then better reconstruct the yarn-dyed fabric image. The improved Euclidean residual enhances the detection ability of unobvious defects, and obtains the final defect detection results. The proposed method effectively avoids the difficulty of collecting a large number of defective samples and manual labeling. Our method obtains 51.34% F1 and 38.30% intersection over union on the YDFID-1 dataset. Experimental results show that the proposed method can achieve higher accuracy of fabric defect detection and location compared with other methods.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Image Processing Techniques and Applications · Surface Roughness and Optical Measurements

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Electronics and Information, Xi'an Polytechnic University, China

State Key Laboratory of Industrial Control Technology, Zhejiang University, China

School of Medical Technology, Beijing Institute of Technology, China

School of Mathematics, Hangzhou Normal University, China

Funding

the Graduate Scientific Innovation Fund for Xi’an Polytechnic University · Natural Science Foundation of Shaanxi Province · the Innovation Capability Support Program of Shaanxi · the Key Research and Development Program of Shaanxi · National Natural Science Foundation of China · the Key R&D Plan of Shaanxi Province

References (52)

Show source-provided references
1. 10.1155/2020/818940310.1155/2020/8189403 ↗
2. 10.1002/col.2226310.1002/col.22263 ↗
3. 10.1109/TIE.1930.89647610.1109/TIE.1930.896476 ↗
4. 10.1016/j.engappai.2022.10506610.1016/j.engappai.2022.105066 ↗
5. 10.1016/j.ijleo.2016.09.11010.1016/j.ijleo.2016.09.110 ↗
6. 10.1515/aut-2015-000110.1515/aut-2015-0001 ↗
7. 10.1177/004051751987990410.1177/0040517519879904 ↗
8. 10.1515/aut-2018-004010.1515/aut-2018-0040 ↗
9. 10.1109/TASE.2017.269674810.1109/TASE.2017.2696748 ↗
10. 10.1007/s00371-020-02040-y10.1007/s00371-020-02040-y ↗
11. 10.1016/j.ins.2020.08.10010.1016/j.ins.2020.08.100 ↗
12. 10.1117/1.OE.56.9.09310410.1117/1.OE.56.9.093104 ↗
13. 10.1109/TASE.2016.252095510.1109/TASE.2016.2520955 ↗
14. 10.1155/2021/994880810.1155/2021/9948808 ↗
15. 10.3390/app1116765710.3390/app11167657 ↗
16. 10.1109/TASE.2018.288603110.1109/TASE.2018.2886031 ↗
17. 10.1109/TIM.2018.279517810.1109/TIM.2018.2795178 ↗
18. Zhang H, Tan Q, Lu S, et al. Yarn-dyed shirt piece defect detection based on an unsupervised reconstruction model of the U-shaped denoising convolutional auto-encoder. Journal of Xidian University 2021; 48: 123–130.
19. 10.1007/s11554-020-01023-510.1007/s11554-020-01023-5 ↗
20. 10.1177/004051751986288010.1177/0040517519862880 ↗
21. Zhang H, Qiao G, Lu S, et al. Attention-based Feature Fusion Generative Adversarial Network for yarn-dyed fabric defect detection. Text Res J 2022; 0: 00405175221129654.
22. 10.1016/j.media.2019.01.01010.1016/j.media.2019.01.010 ↗
23. Zhao Z Li B Dong R et al. A surface defect detection method based on positive samples. In: Pacific rim international conference on artificial intelligence (PRICAI). Nanjing China 28–31 Aug 2018 pp. 473–481. Springer.10.1007/978-3-319-97310-4_54 ↗
24. Liu K, Yu Q, Liu Y, et al. Convolutional graph thermography for subsurface defect detection in polymer composites. IEEE T Instrum Meas 2022; 71.
25. Dosovitskiy A, Beyer L, Kolesnikov A, et al. An image is worth 16 × 16 words: transformers for image recognition at scale. International Conference on Learning Representations (ICLR). Vienna, Austria, 4–8 May 2021, pp: 1–22. OpenReview.net.
26. 10.1177/004051751984063610.1177/0040517519840636 ↗
27. 10.5604/01.3001.0012.751010.5604/01.3001.0012.7510 ↗
28. 10.1108/IJCST-11-2018-013510.1108/IJCST-11-2018-0135 ↗
29. 10.1109/TIM.2020.304719010.1109/TIM.2020.3047190 ↗
30. 10.1177/004051751881365610.1177/0040517518813656 ↗
31. 10.1177/004051752092860410.1177/0040517520928604 ↗
32. Sandler M Howard A Zhu M et al. MobileNetV2: Inverted residuals and linear bottlenecks. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Salt Lake City UT United States 18–22 Jun 2018 pp. 4510–4520. IEEE.10.1109/CVPR.2018.00474 ↗
33. Ronneberger O Fischer P Brox T. U-net: convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention (MICCAI). Munich Germany 5–9 Oct 2015 pp. 234–241. Springer.10.1007/978-3-319-24574-4_28 ↗
34. 10.1177/004051751988412410.1177/0040517519884124 ↗
35. 10.1109/TIP.2019.295974110.1109/TIP.2019.2959741 ↗
36. Zhang H Tang W Zhang L et al. Defect detection of yarn-dyed shirts based on denoising convolutional self-encoder. In: IEEE 8th Data Driven Control and Learning Systems Conference (DDCLS). Dali China 24–27 May 2019 pp. 1263–1268. IEEE.10.1109/DDCLS.2019.8908944 ↗
37. Zhang H, Zhang W, Xiong W, et al. Defect detection of yarn-dyed fabric based on memory denoising convolutional auto-encoder. Basic Sciences Journal of Textile Universities 2022; 35: 64–71.
38. Vaswani A Shazeer N Parmar N et al. Attention is all you need. In: Advances in Neural Information Processing Systems. Long Beach West Coast United States 4–9 Dec 2017 pp. 5998–6008. NIPS.
39. Bao H, Dong L, Wei F. Beit: Bert pre-training of image transformers. arXiv 2021: 210608254.
40. Carion N Massa F Synnaeve G et al. End-to-end object detection with transformers. In: European Conference on Computer Vision (ECCV). Glasgow UK 23–28 Aug 2020 pp. 213–229. Springer.10.1007/978-3-030-58452-8_13 ↗
41. Strudel R Garcia R Laptev I et al. Segmenter: transformer for semantic segmentation. In: IEEE International Conference on Computer Vision (ICCV). Montreal Canada 11–17 Oct 2021 pp. 7262–7272. IEEE.10.1109/ICCV48922.2021.00717 ↗
42. Liu Z Lin Y Cao Y et al. Swin transformer: hierarchical vision transformer using shifted windows. In: IEEE International Conference on Computer Vision (ICCV). Montreal Canada 11–17 Oct 2021 pp. 10012–10022. IEEE.
43. Ren S Zhou D He S et al. Shunted self-attention via multi-scale token aggregation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2022 pp. 10853–10862.10.1109/CVPR52688.2022.01058 ↗
44. Xia Z Pan X Song S et al. Vision transformer with deformable attention. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans State of Louisiana United States 19–24 Jun 2022 pp. 4794–4803. IEEE.
45. Liang J Cao J Sun G et al. Swinir: Image restoration using swin transformer. In: IEEE International Conference on Computer Vision (CVPR). Kuala Lumpur Malaysia 18–20 Dec 2021 pp. 1833–1844. IEEE.10.1109/ICCVW54120.2021.00210 ↗
46. Tang S Zhang J Zhu S et al. Quadtree attention for vision transformers. In: International Conference on Learning Representations (ICLR). virtual 25–29 Apr 2022. pp. 1–16. OpenReview.net.
47. Chen J, Lu Y, Yu Q, et al. TransUNet: Transformers make strong encoders for medical image segmentation. arXiv 2021: 210204306.
48. Zhang H Mi H Lu S et al. Yarn-dyed Fabric Image Dataset Version 1 https://github.com/ZHW-AI/YDFID-1 (2021 accessed 30 June 2021).
49. 10.1109/TAI.2021.305702710.1109/TAI.2021.3057027 ↗
50. 10.1109/ACCESS.2020.302118910.1109/ACCESS.2020.3021189 ↗
51. 10.1016/j.neucom.2019.01.03610.1016/j.neucom.2019.01.036 ↗
52. 10.1109/TPAMI.2018.286530410.1109/TPAMI.2018.2865304 ↗