journal article·2022-07-05Open access

Research on Tiny Target Detection Technology of Fabric Defects Based on Improved YOLO

Xi Yue, Qing Wang, Lei He, Yuxia Li, Dan Tang

Applied Sciences· Volume 12· Issue 13

Abstract

Fabric quality plays a crucial role in modern textile industry processes. How to detect fabric defects quickly and effectively has become the main research goal of researchers. The You Only Look Once (YOLO) series of networks have maintained a dominant position in the field of target detection. However, detecting small-scale objects, such as tiny targets in fabric defects, is still a very challenging task for the YOLOv4 network. To address this challenge, this paper proposed an improved YOLOv4 target detection algorithm: using a combined data augmentation method to expand the dataset and improve the robustness of the algorithm, obtaining the anchors suitable for fabric defect detection by using the k-means algorithm to cluster the ground truth box of the dataset, adding a new prediction layer in yolo_head in order to have a better effect on tiny target detection, integrating a convolutional block attention module into the backbone feature extraction network, and innovatively replacing the CIOU loss function with the CEIOU loss function to achieve accurate classification and localization of defects. Experimental results show that compared with the original YOLOv4 algorithm, the detection accuracy of the improved YOLOv4 algorithm for tiny targets has been greatly increased, the AP value of tiny target detection has increased by 12%, and the overall mean average precision (mAP) has increased by 3%. The prediction results of the proposed algorithm can provide enterprises with more accurate defect positioning, reduce the defect rate of fabric products, and improve their economic effect.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Textile materials and evaluations

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Software Engineering, Chengdu University of Information Technology, Chengdu 610225, China

Sichuan Province Engineering Technology Research Center of Support Software of Informatization Application, Chengdu 610225, China

School of Software Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China

Funding

Research and application of deep learning open sharing platform based on natural language processing · Key Projects of Global Change and Response of Ministry of Science and Technology of China · Science and Technology Support Project of Sichuan Province

References (41)

Show source-provided references
1. Automatic fabric fault detection using morphological operations on bit plane
2. Wavelet based methods on patterned fabric defect detection10.1016/j.patcog.2004.07.009 ↗
3. Evaluation of the effects of Gabor filter parameters on texture classification10.1016/j.patcog.2007.04.023 ↗
4. Automated inspection of textile fabrics using textural models10.1109/34.85670 ↗
5. Xu, Y.C., Meng, F.W., Wang, L.Z., Zhang, M.Y., Wu, C.S., and Assoc Comp, M. (2021, January 28–30). Fabric Surface Defect Detection Based on GMRF Model. Proceedings of the 2nd International Conference on Artificial Intelligence and Information Systems (ICAIIS ), Chongqing, China.10.1145/3469213.3471336 ↗
6. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.322 ↗
7. Lin, T.-Y., Dollár, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature pyramid networks for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
8. Ren, S., He, K., Girshick, R., and Sun, J. (2015). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. Adv. Neural Inf. Process. Syst., 28.
9. Karpiński, R., Krakowski, P., Jonak, J., Machrowska, A., Maciejewski, M., and Nogalski, A. (2022). Diagnostics of Articular Cartilage Damage Based on Generated Acoustic Signals Using ANN—Part I: Femoral-Tibial Joint. Sensors, 22.10.3390/s22062176 ↗
10. Liao, Y.-T., Lee, C.-H., Chen, K.-S., Chen, C.-P., and Pai, T.-W. (2021). Data Augmentation Based on Generative Adversarial Networks to Improve Stage Classification of Chronic Kidney Disease. Appl. Sci., 12.10.3390/app12010352 ↗
11. Liu, S., Yang, B., Wang, Y., Tian, J., Yin, L., and Zheng, W. (2022). 2D/3D Multimode Medical Image Registration Based on Normalized Cross-Correlation. Appl. Sci., 12.10.3390/app12062828 ↗
12. Sun, M., Lu, L., Hameed, I.A., Kulseng, C.P.S., and Gjesdal, K.-I. (2021). Detecting Small Anatomical Structures in 3D Knee MRI Segmentation by Fully Convolutional Networks. Appl. Sci., 12.10.3390/app12010283 ↗
13. Zheng, W., Tian, X., Yang, B., Liu, S., Ding, Y., Tian, J., and Yin, L. (2022). A Few Shot Classification Methods Based on Multiscale Relational Networks. Appl. Sci., 12.10.3390/app12084059 ↗
14. Guo, S.-S., Lee, K.-H., Chang, L., Tseng, C.-D., Sie, S.-J., Lin, G.-Z., Chen, J.-Y., Yeh, Y.-H., Huang, Y.-J., and Lee, T.-F. (2022). Development of an Automated Body Temperature Detection Platform for Face Recognition in Cattle with YOLO V3-Tiny Deep Learning and Infrared Thermal Imaging. Appl. Sci., 12.10.3390/app12084036 ↗
15. Zhou, Y., Wen, S., Wang, D., Mu, J., and Richard, I. (2021). Object Detection in Autonomous Driving Scenarios Based on an Improved Faster-RCNN. Appl. Sci., 11.10.3390/app112411630 ↗
16. Dewi, C., Chen, R.-C., Jiang, X., and Yu, H. (2022). Deep convolutional neural network for enhancing traffic sign recognition developed on Yolo V4. Multimed. Tools Appl., 1–25.10.1007/s11042-022-12962-5 ↗
17. Zheng, W., Zhou, Y., Liu, S., Tian, J., Yang, B., and Yin, L. (2022). A Deep Fusion Matching Network Semantic Reasoning Model. Appl. Sci., 12.10.3390/app12073416 ↗
18. Fabric defect detection based on multiple fractal features and support vector data description10.1016/j.engappai.2008.05.006 ↗
19. Fabric Defect Segmentation Method Based on Deep Learning
20. Zhu, X., Lyu, S., Wang, X., and Zhao, Q. (2021, January 11–17). TPH-YOLOv5: Improved YOLOv5 Based on Transformer Prediction Head for Object Detection on Drone-captured Scenarios. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops, Montreal, BC, Canada.10.1109/ICCVW54120.2021.00312 ↗
21. Detecting textile micro-defects: A novel and efficient method based on visual gain mechanism10.1016/j.ins.2020.06.035 ↗
22. Jing, J., Zhuo, D., Zhang, H., Liang, Y., and Zheng, M. (2020). Fabric defect detection using the improved YOLOv3 model. J. Eng. Fibers Fabr., 15.10.1177/1558925020908268 ↗
23. A Fabric Defect Detection System Based Improved YOLOv5 Detector10.1088/1742-6596/2010/1/012191 ↗
24. Development of a real-time machine vision system for functional textile fabric defect detection using a deep YOLOv4 model10.1177/00405175211034241 ↗
25. Kahraman, Y., and Durmuşoğlu, A. (2022). Classification of Defective Fabrics Using Capsule Networks. Appl. Sci., 12.10.3390/app12105285 ↗
26. Zheng, L., Wang, X., Wang, Q., Wang, S., and Liu, X. (2021, January 10–13). A Fabric Defect Detection Method Based on Improved YOLOv5. Proceedings of the 2021 7th International Conference on Computer and Communications (ICCC), Chengdu, China.10.1109/ICCC54389.2021.9674548 ↗
27. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
28. Ma, N., Zhang, X., Liu, M., and Sun, J. (2021, January 20–25). Activate or not: Learning customized activation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00794 ↗
29. Transmission line fault detection based on YOLOv4 with attention mechanism
30. Improved YOLO V3 algorithm and its application in small target detection10.3788/AOS201939.0715004 ↗
31. Research on Small Target Detection in Driving Scenarios Based on Improved Yolo Network10.1109/ACCESS.2020.2966328 ↗
32. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
33. Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv.
34. Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv.
35. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016). SSD: Single Shot MultiBox Detector. European Conference on Computer Vision, Springer.10.1007/978-3-319-46448-0_2 ↗
36. Tian, Z., Shen, C., Chen, H., and He, T. (2019, January 27–28). Fcos: Fully convolutional one-stage object detection. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Korea.10.1109/ICCV.2019.00972 ↗
37. Tan, M., Pang, R., and Le, Q.V. (2020, January 13–19). Efficientdet: Scalable and efficient object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01079 ↗
38. Wang, K., Liew, J.H., Zou, Y., Zhou, D., and Feng, J. (2019, January 27–28). Panet: Few-shot image semantic segmentation with prototype alignment. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Korea.10.1109/ICCV.2019.00929 ↗
39. Nair, V., and Hinton, G.E. (2010, January 21–24). Rectified linear units improve restricted boltzmann machines. Proceedings of the Icml, Haifa, Israel.
40. Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8–14). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
41. Cai, Z., and Vasconcelos, N. (2018, January 18–23). Cascade r-cnn: Delving into high quality object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00644 ↗