A Novel Deep Learning Approach for Yarn Hairiness Characterization Using an Improved YOLOv5 Algorithm
Source abstract
Abstract
In textile manufacturing, ensuring high-quality yarn is crucial, as it directly influences the overall quality of the end product. However, imperfections like protruding and loop fibers, known as ‘hairiness’, can significantly impact yarn quality, leading to defects in the final fabrics. Controlling yarn quality in the spinning process is essential, but current commercial equipment is expensive and limited to analyzing only a few parameters. The advent of artificial intelligence (AI) offers a promising solution to this challenge. By utilizing deep learning algorithms, a model can detect various yarn irregularities, including thick places, thin places, and neps, while characterizing hairiness by distinguishing between loop and protruding fibers in digital yarn images. This paper proposes a novel approach using deep learning, specifically, an enhanced algorithm based on YOLOv5s6, to characterize different types of yarn hairiness. Key performance indicators include precision, recall, F1-score, mAP0.5:0.95, and mAP0.5. The experimental results show significant improvements, with the proposed algorithm increasing model mAP0.5 by 5% to 6% and mAP0.5:0.95 by 11% to 12% compared to the standard YOLOv5s6 model. A 10k-fold cross-validation method is applied, providing an accurate estimate of the performance on unseen data and facilitating unbiased comparisons with other approaches.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Textile materials and evaluations · Industrial Vision Systems and Defect Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
MEtRICs Research Center, University of Minho, Campus of Azurém, 4800-058 Guimarães, Portugal
Algoritmi Research Centre, School of Engineering, University of Minho, 4800-058 Guimaraes, Portugal
2Ai, School of Technology, IPCA, 4750-810 Barcelos, Portugal
2C2T Research Centre, School of Engineering, University of Minho, 4800-058 Guimaraes, Portugal
Funding
FCT—Fundação para a Ciência e Tecnologia (Portugal) · RD Units Project Scope
References (67)
Show source-provided references
1. Araújo, M., and Melo, E.M.C. (1987). Manual de Engenharia Têxtil, Fundação Calouste Gulbenkian.
2. Minimization of Defects in Knitted Fabric
3. Lord, P.R. (2003). 11—Quality and quality control. Handbook of Yarn Production, Woodhead Publishing.10.1533/9781855738652 ↗
4. Yarn Hairiness Characterization Using Two Orthogonal Directions10.1109/TIM.2008.2005082 ↗
5. Pinto, R., Pereira, F., Carvalho, V., Soares, F., and Vasconcelos, R. (2019, January 14–17). Yarn linear mass determination using image processing: First insights. Proceedings of the IECON 2019—45th Annual Conference of the IEEE Industrial Electronics Society, Lisboa, Portugal.10.1109/IECON.2019.8926650 ↗
6. Hu, J. (2011). 1—Digital technology for yarn structure and appearance analysis. Computer Technology for Textiles and Apparel, Woodhead Publishing.10.1533/9780857093608 ↗
7. Lawrence, C.A. (2010). 5—Yarn structure and properties from different spinning techniques. Advances in Yarn Spinning Technology, Woodhead Publishing.10.1533/9780857090218 ↗
8. Wang, X.-H., Wang, J.-Y., Zhang, J.-L., Liang, H.-W., and Kou, P.-M. (2010, January 11–14). Study on the detection of yarn hairiness morphology based on image processing technique. Proceedings of the 2010 International Conference on Machine Learning and Cybernetics, Qingdao, China.10.1109/ICMLC.2010.5580660 ↗
9. Wang, L., Xu, B., and Gao, W. (2018, January 22–26). 3D measurement of yarn hairiness via multi-perspective images. Proceedings of the Optics, Photonics, and Digital Technologies for Imaging Applications V, Proceedings of the SPIE Photonic Europe, Strasbourg, France.
10. Measurement of long yarn hair based on hairiness segmentation and hairiness tracking
11. El Mogahzy, Y.E. (2009). 9—Structure and types of yarn for textile product design. Engineering Textiles, Woodhead Publishing.10.1533/9781845695415 ↗
12. Yarn hairiness versus quality of yarn10.1080/00405000.2013.800377 ↗
13. Kiron, M.I. (2023, July 23). Spin Finish in Textile. Textile Learner. Available online: https://textilelearner.net/spin-finish-in-textile/.
14. Pilling Resistance of Knitted Fabrics
15. Wong, W.K. (2018). 6—Computer vision techniques for detecting yarn defects. Applications of Computer Vision in Fashion and Textiles, Woodhead Publishing.10.1016/B978-0-08-101217-8.00003-8 ↗
16. Carvalho, V., Soares, F., Belsley, M., and Vasconcelos, R.M. (2008, January 26–29). Automatic yarn characterization system. Proceedings of the 2008 IEEE SENSORS, Lecce, Italy.10.1109/ICSENS.2008.4716557 ↗
17. Machado, J., Soares, F., Trojanowska, J., and Yildirim, S. (2022). A Review in the Use of Artificial Intelligence in Textile Industry. Innovations in Mechatronics Engineering, Springer International Publishing.10.1007/978-3-030-79168-1 ↗
18. Pereira, F., Macedo, A., Pinto, L., Soares, F., Vasconcelos, R., Machado, J., and Carvalho, V. (2023). Intelligent Computer Vision System for Analysis and Characterization of Yarn Quality. Electronics, 12.10.3390/electronics12010236 ↗
19. Machado, J., Soares, F., Trojanowska, J., and Ottaviano, E. (2022). Textile Yarn Winding and Unwinding System. Innovations in Mechanical Engineering, Springer International Publishing.10.1007/978-3-030-79165-0 ↗
20. Automatic system for yarn quality analysis by image processing10.1007/s40430-022-03875-3 ↗
21. (2023, August 06). GitHub—Ultralytics/Yolov5: YOLOv5 in PyTorch > ONNX > CoreML > TFLite. Available online: https://github.com/ultralytics/yolov5.
22. Chen, S., Tang, M., and Kan, J. (2019). Predicting Depth from Single RGB Images with Pyramidal Three-Streamed Networks. Sensors, 19.10.3390/s19030667 ↗
23. Lameness detection of dairy cows based on a double normal background statistical model10.1016/j.compag.2019.01.025 ↗
24. Improved YOLOv5 for Aerial Images Based on Attention Mechanism10.1109/ACCESS.2023.3277931 ↗
25. Tan, S., Lu, G., Jiang, Z., and Huang, L. (2021, January 4–6). Improved YOLOv5 Network Model and Application in Safety Helmet Detection. Proceedings of the 2021 IEEE International Conference on Intelligence and Safety for Robotics (ISR), Tokoname, Japan.10.1109/ISR50024.2021.9419561 ↗
26. An Improved YOLOv5 Method for Small Object Detection in UAV Capture Scenes10.1109/ACCESS.2023.3241005 ↗
27. Blood Cell Detection Method Based on Improved YOLOv510.1109/ACCESS.2023.3290905 ↗
28. YOLO-FIRI: Improved YOLOv5 for Infrared Image Object Detection10.1109/ACCESS.2021.3120870 ↗
29. Li, Y., Cheng, R., Zhang, C., Chen, M., Ma, J., and Shi, X. (2022, January 28–30). Sign language letters recognition model based on improved YOLOv5. Proceedings of the 2022 9th International Conference on Digital Home (ICDH), Guangzhou, China.10.1109/ICDH57206.2022.00036 ↗
30. Object Detection Algorithms Compression CNN. YOLO and SSD
31. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified. Real-Time Object Detection. Presented at the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA. Available online: https://www.cv-foundation.org/openaccess/content_cvpr_2016/html/Redmon_You_Only_Look_CVPR_2016_paper.html.10.1109/CVPR.2016.91 ↗
32. Redmon, J., and Farhadi, A. (2024, July 06). YOLO9000: Better. Faster. Stronger. Presented at the IEEE Conference on Computer Vision and Pattern Recognition, Available online: https://openaccess.thecvf.com/content_cvpr_2017/html/Redmon_YOLO9000_Better_Faster_CVPR_2017_paper.html.10.1109/CVPR.2017.690 ↗
33. Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv.
34. Gašparović, B., Mauša, G., Rukavina, J., and Lerga, J. (2023, January 20–23). Evaluating YOLOV5. YOLOV6. YOLOV7. and YOLOV8 in Underwater Environment: Is There Real Improvement?. Proceedings of the 2023 8th International Conference on Smart and Sustainable Technologies (SpliTech), Split/Bol, Croatia.10.23919/SpliTech58164.2023.10193505 ↗
35. Wu, T., and Dong, Y. (2023). YOLO-SE: Improved YOLOv8 for Remote Sensing Object Detection and Recognition. Appl. Sci., 13.10.3390/app132412977 ↗
36. Sun, J., Jia, J., Tang, C.-K., and Shum, H.-Y. (2004). Poisson matting. ACM SIGGRAPH 2004 Papers, Proceeding of the SIGGRAPH’04, Los Angeles, CA, USA, 8–12 August 2004, Association for Computing Machinery.10.1145/1186562.1015721 ↗
37. Yarn Tensile Properties Modeling Using Artificial Intelligence10.1016/j.aej.2020.07.049 ↗
38. Prediction of Cotton Yarn’s Characteristics by Image Processing and ANN10.1016/j.aej.2021.08.057 ↗
39. A New Method to Evaluate Yarn Appearance Qualities Based on Machine Vision and Image Processing10.1109/ACCESS.2020.2972967 ↗
40. An algorithm for cross-fiber separation in yarn hairiness image processing—The visual computer10.1007/s00371-023-03053-z ↗
41. A computer vision based online quality control system for textile yarns10.1016/j.compind.2021.103550 ↗
42. Lu, W., and Yang, M. (2019, January 15–16). Face Detection Based on Viola-Jones Algorithm Applying Composite Features. Proceedings of the 2019 International Conference on Robots & Intelligent System (ICRIS), Haikou, China.10.1109/ICRIS.2019.00029 ↗
43. Watson, G.A. (1978). The Levenberg-Marquardt algorithm: Implementation and theory. Numerical Analysis, Springer.
44. Assessing the Effectiveness of YOLO Architectures for Smoke and Wildfire Detection10.1109/ACCESS.2023.3312217 ↗
45. Guo, P., Meng, W., Xu, M., Li, V.C., and Bao, Y. (2021). Predicting Mechanical Properties of High-Performance Fiber-Reinforced Cementitious Composites by Integrating Micromechanics and Machine Learning. Materials, 14.10.3390/ma14123143 ↗
46. Automatic segmentation of prostate MRI using convolutional neural networks: Investigating the impact of network architecture on the accuracy of volume measurement and MRI-ultrasound registration10.1016/j.media.2019.101558 ↗
47. Niu, D., Liang, Y., Wang, H., Wang, M., and Hong, W.-C. (2017). Icing Forecasting of Transmission Lines with a Modified Back Propagation Neural Network-Support Vector Machine-Extreme Learning Machine with Kernel (BPNN-SVM-KELM) Based on the Variance-Covariance Weight Determination Method. Energies, 10.10.3390/en10081196 ↗
48. Srinivas, A., Lin, T.-Y., Parmar, N., Shlens, J., Abbeel, P., and Vaswani, A. (2021, January 20–25). Bottleneck Transformers for Visual Recognition. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA. Available online: https://openaccess.thecvf.com/content/CVPR2021/html/Srinivas_Bottleneck_Transformers_for_Visual_Recognition_CVPR_2021_paper.html.10.1109/CVPR46437.2021.01625 ↗
49. Sim-YOLOv5s: A method for detecting defects on the end face of lithium battery steel shells10.1016/j.aei.2022.101824 ↗
50. DenseSPH-YOLOv5: An automated damage detection model based on DenseNet and Swin-Transformer prediction head-enabled YOLOv5 with attention mechanism10.1016/j.aei.2023.102007 ↗
51. Hendrycks, D., and Gimpel, K. (2023). Gaussian Error Linear Units (GELUs). arXiv.
52. Yu, G., and Zhou, X. (2023). An Improved YOLOv5 Crack Detection Method Combined with a Bottleneck Transformer. Mathematics, 11.10.3390/math11102377 ↗
53. TBi-YOLOv5: A surface defect detection model for crane wire with Bottleneck Transformer and small target detection layer10.1177/09544062231187606 ↗
54. OAB-YOLOv5: One-Anchor-Based YOLOv5 for Rotated Object Detection in Remote Sensing Images10.1155/2022/8515510 ↗
55. Optimizing the Hyperparameter Tuning of YOLOv5 for Underwater Detection10.1109/ACCESS.2022.3174583 ↗
56. Insulator Detection in Intelligent Monitoring Based on Yolo Family and Customizing Hyperparameters10.54644/jte.75A.2023.1308 ↗
57. Pereira, F., Pinto, L., Machado, J., Soares, F., Vasconcelos, R., and Carvalho, V. (2023). Yarn Hairiness—Loop & Protruding Fibers Dataset, Mendeley Data.10.1016/j.dib.2024.110355 ↗
58. Online yarn hairiness—Loop & protruding fibers dataset10.1016/j.dib.2024.110355 ↗
59. (2024, July 06). “Roboflow: Computer Vision Tools for Developers and Enterprises. Available online: https://roboflow.com/.
60. (2024, July 06). “Labeling with LabelMe: Step-by-Step GUIDE [Alternatives + Datasets]. Available online: https://www.v7labs.com/blog/labelme-guide/.
61. Mullen, J.F., Tanner, F.R., and Sallee, P.A. (2019, January 16–17). Comparing the Effects of Annotation Type on Machine Learning Detection Performance. Proceedings of the 2019 IEEECVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Long Beach, CA, USA.10.1109/CVPRW.2019.00114 ↗
62. Lin, G., Liu, K., Xia, X., and Yan, R. (2023). An Efficient and Intelligent Detection Method for Fabric Defects based on Improved YOLOv5. Sensors, 23.10.3390/s23010097 ↗
63. Understanding and combating robust overfitting via input loss landscape analysis and regularization10.1016/j.patcog.2022.109229 ↗
64. Keeping Deep Learning Models in Check: A History-Based Approach to Mitigate Overfitting10.1109/ACCESS.2024.3402543 ↗
65. Uddin, S., Lu, H., Rahman, A., and Gao, J. (2024). A novel approach for assessing fairness in deployed machine learning algorithms. Sci. Rep., 14.10.1038/s41598-024-68651-w ↗
66. Hassan, A., Gulzar Ahmad, S., Ullah Munir, E., Ali Khan, I., and Ramzan, N. (2024). Predictive modelling and identification of key risk factors for stroke using machine learning. Sci. Rep., 14.10.1038/s41598-024-61665-4 ↗
67. Aljalal, M., Aldosari, S.A., Molinas, M., and Alturki, F.A. (2024). Selecting EEG channels and features using multi-objective optimization for accurate MCI detection: Validation using leave-one-subject-out strategy. Sci. Rep., 14.10.1038/s41598-024-63180-y ↗