Enhanced fabric detection network with retained low-level texture features and adaptive anchors
Source abstract
Abstract
Fabric defect detection is crucial in the textile industry, as it suffers from challenges such as small defect sizes, diverse morphologies, and imbalanced sample distributions. Current mainstream methods approach it as an object detection problem. Many fabric defects, particularly small ones, are caused by production faults that disrupt the fabric texture. These defects often lack distinct structural information, which poses a challenge for object detection methods that rely heavily on such features. To address these limitations, we propose a multi-scale detection channel based on Low-level Texture Feature Retention (LTFR), which significantly enhances the detection capability for small-size defects. Additionally, we introduce Powerful-IoU (PIoU) to guide anchors along effective paths for regression, improving localization accuracy for defects with extreme aspect ratios. To further tackle the issue of imbalanced sample distribution, we adopt the SlideLoss function, which adaptively adjusts the weights of easy and hard samples, offering a more effective solution than the traditional binary cross-entropy classification loss. Experimental results on the publicly available fabric defect dataset from Alibaba Cloud Tianchi show that the model achieves mAP@0.5 and mAP@0.5:0.95 values of 49% and 24%, respectively, which represent improvements of 8.4% and 4.8% over the baseline YOLOv8. Even compared to the state-of-the-art YOLOv9-c, the mAP@0.5 value shows a further improvement of 5.1%. These results confirm the effectiveness of the proposed method and highlight its potential as a valuable guide for researchers in the field of fabric defect detection.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Image Processing Techniques and Applications · Image and Object Detection Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Research and Development Department, Zhengzhou Hongda New Textile Machinery Co., Ltd.
Funding
Henan province key science and technology research projects · National Natural Science Foundation of China · Leading talents of science and technology in the Central Plain of China
References (58)
Show source-provided references
1. 10.1016/j.eswa.2021.11483810.1016/j.eswa.2021.114838 ↗
2. 10.1016/j.neucom.2017.02.02110.1016/j.neucom.2017.02.021 ↗
3. 10.1007/s11042-018-6483-610.1007/s11042-018-6483-6 ↗
4. 10.1016/j.ins.2019.10.03210.1016/j.ins.2019.10.032 ↗
5. 10.1109/TIM.2021.305673810.1109/TIM.2021.3056738 ↗
6. 10.1007/s00371-022-02706-910.1007/s00371-022-02706-9 ↗
7. Wang X, Pan R, Gao W. Fabric defect detection method using optimized sparse dictionary. J Textil Res 2023; 44(08): 81–87.
8. 10.1177/152808371455577710.1177/1528083714555777 ↗
9. 10.1007/s11760-016-0939-910.1007/s11760-016-0939-9 ↗
10. 10.1080/00405000.2014.91606310.1080/00405000.2014.916063 ↗
11. Yıldız K, Buldu A. Wavelet transform and principal component analysis in fabric defect detection and classification. Pamukkale University Journal of Engineering Sciences 2016; 23(5): 622–627.10.5505/pajes.2016.80037 ↗
12. Yıldız K, Demir Ö, Ülkü EE. Fault detection of fabrics using image processing methods. Pamukkale University Journal of Engineering Sciences 2017; 23(7): 841–844.10.5505/pajes.2017.09821 ↗
13. Yıldız K, Yıldız Z, Demir Ö, et al. Determination of yarn twist using image processing techniques. InInternational Conference on Image Processing. International Conference on Image Processing, Production and Computer Science The Nanjing 2015; 39: 83–88.
14. Bocekci VG, Yildiz K. Classification of textures using filter based local feature extraction. EDP Sciences 2016; 75: 03001.
15. 10.1177/0040517522111147710.1177/00405175221111477 ↗
16. Yang X. Fabric defect detection of statistic aberration feature based on gmrf model. J Text Res 2013; 4: 026.
17. Liu Z, Liu S, Dong Y, et al. Fabric defects detection based on multi-sources features fusion. In Proceedings of the 2019 8th International Conference on Computing and Pattern Recognition 2019; 100–105.
18. He D, Wen J, Lai Z. Textile fabric defect detection based on improved faster r-cnn. AATCC Journal of Research (AATCC J. Res) 2021; 8(1 suppl): 82–90.10.14504/ajr.8.S1.11 ↗
19. 10.1177/004051752095522910.1177/0040517520955229 ↗
20. Xie G, Yang X, Zhiqi Y, et al. An intelligent defect detection system for warp-knitted fabric. Textil Res J 2022; 92(9-10): 1394–1404.
21. Lee SH, Chan CS, Mayo SJ, et al. How deep learning extracts and learns leaf features for plant classification. Pattern Recogn 2017; 71: 1–13.10.1016/j.patcog.2017.05.015 ↗
22. 10.1016/j.neucom.2020.09.04610.1016/j.neucom.2020.09.046 ↗
23. Zhao Y, Li J, Zhang Q, et al. Simultaneous detection of defects in electrical connectors based on improved convolutional neural network. IEEE Trans Instrum Meas 2022; 71: 1–10.
24. Ren S, He K, Girshick R, et al. Faster r-cnn: towards real-time object detection with region proposal networks. IEEE transactions on pattern analysis and machine intelligence 2016; 39(6): 37–49.
25. He K, Gkioxari G, Dollar P, et al. Mask r-cnn. In Proceedings of the IEEE international conference on computer vision 2017; 2961–2969.
26. Cai Z, Vasconcelos N. Cascade r-cnn: delving into high quality object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition 2018; 6154–6162.
27. Song G, Liu Y, Wang X. Revisiting the sibling head in object detector. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition 2020; 11563–11572.
28. Redmon J, Ali F. YOLO9000: better, faster, stronger. In Proceedings of the IEEE conference on computer vision and pattern recognition 2017; 7263–7271.
29. Redmon J Ali F. YOLOv3: an incremental improvement. arXiv preprint arXiv:1804.02767 2018a.
30. Liu W, Anguelov D, Erhan D, et al. Ssd: single shot multibox detector. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands 2016; 21–37.10.1007/978-3-319-46448-0_2 ↗
31. Lin T Priya G Ross G Kaiming H Piotr D. “Focal loss for dense object detection.” In Proceedings of the IEEE international conference on computer vision pp. 2980-2988. 2017.10.1109/ICCV.2017.324 ↗
32. Tan M, Pang R, Efficientdet QVL. Scalable and efficient object detection. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition 2020; 10781–10790.
33. Law H, Deng J. Cornernet: detecting objects as paired keypoints. In Proceedings of the European conference on computer vision (ECCV) 2018; 734–750.
34. Zhou X, Zhuo J, Krahenbuhl P. Bottom-up object detection by grouping extreme and center points. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition 2019; 850–859.
35. Tian Z, Shen C, Chen H, et al. Fcos: fully convolutional one-stage object detection. corr abs/1904.01355 (2019). In Proceedings of the IEEE/CVF international conference on computer vision 2019.
36. Carranza-Garc´ıa M, Torres-Mateo J, Lara-Benıtez P, et al. On the performance of one-stage and two-stage object detectors in autonomous vehicles using camera data. Remote Sens 2020; 13(1): 89.10.3390/rs13010089 ↗
37. Miao R, Shan Z, Zhou Q, et al. Real-time defect identification of narrow overlap welds and application based on convolutional neural networks. J Manuf Syst 2022; 62: 800–810.10.1016/j.jmsy.2021.01.012 ↗
38. Tulbure A-A, Tulbure A-A, Dulf EH. A review on modern defect detection models using dcnns–deep convolutional neural networks. J Adv Res 2022; 35: 33–48.10.1016/j.jare.2021.03.015 ↗
39. Li Y, Zhang D, Lee D-J. Automatic fabric defect detection with a wide-and compact network. Neurocomputing 2019b; 329: 329–338.10.1016/j.neucom.2018.10.070 ↗
40. 10.3390/s2015426010.3390/s20154260 ↗
41. 10.1016/j.displa.2021.10200810.1016/j.displa.2021.102008 ↗
42. Zhang H-w, Zhang L-j, Li P-f, et al. Yarndyed fabric defect detection with YOLOv2 based on deep convolution neural networks. In 2018 IEEE 7th data driven control and learning systems conference (DDCLS) 2018; 170–174.
43. 10.1177/155892502090826810.1177/1558925020908268 ↗
44. 10.1155/2021/732139410.1155/2021/7321394 ↗
45. 10.1177/004051752092860410.1177/0040517520928604 ↗
46. Zhou X, Chen Y, Lu X. Study on detection method of small-size solder ball defects. In 2017 2nd IEEE International Conference on Integrated Circuits and Microsystems (ICICM) 2017; 213–217.
47. Li P, Dong Z, Shi J, et al. Detection of small size defects in belt layer of radial tire based on improved faster r-cnn. In 2021 11th International Conference on Information Science and Technology (ICIST) 2021; 531–538.
48. Farhadi A, Farhadi Yolov3 J. Yolov3: An incremental improvement. In Computer vision and pattern recognition 2018; 1804: 1–6.
49. Liu S, Qi L, Qin H, et al. Path aggregation network for instance segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition 2018; 8759–8768.
50. Yu J, Jiang Y, Wang Z, et al. Unitbox: an advanced object detection network. In Proceedings of the 24th ACM international conference on Multimedia 2016; 516–520.
51. Zheng Z, Wang P, Ren D, et al. Enhancing geometric factors in model learning and inference for object detection and instance segmentation. IEEE Trans Cybern 2021; 52(8): 8574–8586.10.1109/TCYB.2021.3095305 ↗
52. 10.1609/aaai.v34i07.699910.1609/aaai.v34i07.6999 ↗
53. 10.1016/j.neucom.2022.07.04210.1016/j.neucom.2022.07.042 ↗
54. Tong Z Chen Y Xu Z et al. Wiseiou: bounding box regression loss with dynamic focusing mechanism. arXiv preprint arXiv:2301.10051 2023.
55. Shrivastava A, Gupta A, Girshick R. Training region-based object detectors with online hard example mining. In Proceedings of the IEEE conference on computer vision and pattern recognition 2016; 761–769.
56. Lin TY Goyal P Girshick R He K Dollár P. Focal loss for dense object detection. In Proceedings of the IEEE international conference on computer vision 2017; 2980–2988.10.1109/ICCV.2017.324 ↗
57. 10.1609/aaai.v33i01.3301823110.1609/aaai.v33i01.33018231 ↗
58. Zhang S, Zhu X, Lei Z, et al. Faceboxes: a cpu real-time face detector with high accuracy. IEEE International Joint Conference on Biometrics (IJCB) 2017; 1–9.