journal article·2022-03

Development of a real-time machine vision system for functional textile fabric defect detection using a deep YOLOv4 model

Sifundvolesihle Dlamini, Chih-Yuan Kao, Shun-Lian Su, Chung-Feng Jeffrey Kuo

Textile Research Journal· Volume 92· Issue 5-6
Publisher page

Abstract

We introduce a real-time machine vision system we developed with the aim of detecting defects in functional textile fabrics with good precision at relatively fast detection speeds to assist in textile industry quality control. The system consists of image acquisition hardware and image processing software. The software we developed uses data preprocessing techniques to break down raw images to smaller suitable sizes. Filtering is employed to denoise and enhance some features. To generalize and multiply the data to create robustness, we use data augmentation, which is followed by labeling where the defects in the images are labeled and tagged. Lastly, we utilize YOLOv4 for localization where the system is trained with weights of a pretrained model. Our software is deployed with the hardware that we designed to implement the detection system. The designed system shows strong performance in defect detection with precision of [Formula: see text], and recall and [Formula: see text] scores of [Formula: see text] and [Formula: see text], respectively. The detection speed is relatively fast at [Formula: see text] fps with a prediction speed of [Formula: see text] ms. Our system can automatically locate functional textile fabric defects with high confidence in real time.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Image Processing Techniques and Applications · Optical measurement and interference techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Materials Science and Engineering, National Taiwan University of Science and Technology, Taipei, Taiwan

Machine Vision Department, BenQ Materials Corporation, Taoyuan, Taiwan

References (64)

Show source-provided references
1. 10.1016/j.imavis.2011.02.00210.1016/j.imavis.2011.02.002 ↗
2. 10.1109/TIE.1930.89647610.1109/TIE.1930.896476 ↗
3. 10.1080/00405000.2015.106176010.1080/00405000.2015.1061760 ↗
4. 10.1007/s00170-017-0882-010.1007/s00170-017-0882-0 ↗
5. 10.1016/j.cirp.2016.04.07210.1016/j.cirp.2016.04.072 ↗
6. Bodnarova A, Bennamoun M and Kubik K. Defect detection in textile materials based on aspects of the HVS. In: 1998 IEEE international conference on systems, man, and cybernetics (SMC'98 Conference Proceedings) (Cat No 98CH36216) , San Diego, Ca, USA. 11–14 October 1998. IEEE. pp.4423–4428.10.1109/ICSMC.1998.727546 ↗
7. 10.1016/j.patcog.2007.11.01410.1016/j.patcog.2007.11.014 ↗
8. 10.1515/aut-2015-000110.1515/aut-2015-0001 ↗
9. 10.1016/S0262-8856(99)00062-110.1016/S0262-8856(99)00062-1 ↗
10. 10.1109/28.87127410.1109/28.871274 ↗
11. 10.1016/S0262-8856(03)00007-610.1016/S0262-8856(03)00007-6 ↗
12. 10.1117/1.151729010.1117/1.1517290 ↗
13. Sari-Sarraf H and Goldard JS. Vision system for on-loom fabric inspection. In: 1998 IEEE annual textile, fiber and film industry technical conference (Cat No 98CH36246) , Charlotte, NC, USA. 5–7 May 1998. IEEE. pp.8/1–810.10.1109/TEXCON.1998.679228 ↗
14. 10.1016/j.patcog.2003.10.01110.1016/j.patcog.2003.10.011 ↗
15. 10.1016/j.patcog.2004.07.00910.1016/j.patcog.2004.07.009 ↗
16. 10.1177/00405175900600040410.1177/004051759006000404 ↗
17. Guo C, Ma Q and Zhang L. Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform. In: 2008 IEEE conference on computer vision and pattern recognition , Anchorage, AK, USA. 23–28 June 2008. IEEE. pp.1–8.
18. Campell J, Hashim A and Murtagh F. Flaw detection in woven textile using space-dependent Fourier transform. Magee College, preprint: INFM-97-004 . 16 May 1997.
19. 10.1109/TASE.2017.269674810.1109/TASE.2017.2696748 ↗
20. 10.1109/34.8567010.1109/34.85670 ↗
21. 10.1109/TMM.2014.229883210.1109/TMM.2014.2298832 ↗
22. 10.1109/CVPR.2015.729896510.1109/CVPR.2015.7298965 ↗
23. 10.1038/nature1453910.1038/nature14539 ↗
24. 10.1111/cote.1239410.1111/cote.12394 ↗
25. 10.1177/004051752093598410.1177/0040517520935984 ↗
26. 10.1177/004051752095522910.1177/0040517520955229 ↗
27. 10.1177/155892502090826810.1177/1558925020908268 ↗
28. 10.1109/CVPR.2016.9110.1109/CVPR.2016.91 ↗
29. 10.1109/ICPR.2006.47910.1109/ICPR.2006.479 ↗
30. 10.1109/CVPR.2017.69010.1109/CVPR.2017.690 ↗
31. Ioffe S, Szegedy C. Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:150203167 2015.
32. Zhang Y, Zhang H and Huang TS. Collaborative and compressive high-resolution imaging. In: proceedings of the 21st international conference on pattern recognition (ICPR2012) , Tsukuba, Japan. 11–15 November 2012. IEEE. pp.3062–3065.
33. Chen Y, Han C, Wang N, et al. Revisiting feature alignment for one-stage object detection. arXiv preprint arXiv:190801570 2019.
34. 10.1016/j.csda.2007.02.00910.1016/j.csda.2007.02.009 ↗
35. Redmon J, Farhadi A. Yolov3: an incremental improvement. arXiv preprint arXiv:180402767 2018.
36. 10.1109/CVPR.2017.10610.1109/CVPR.2017.106 ↗
37. 10.1109/CVPR.2016.9010.1109/CVPR.2016.90 ↗
38. Srivastava N · Journal Mach Learn Res · 2014 · 15 · 1929
39. Bochkovskiy A, Wang C-Y, Liao H-YM. YOLOv4: optimal speed and accuracy of object detection. arXiv preprint arXiv:200410934 2020.
40. 10.1109/ICCV.2019.0061210.1109/ICCV.2019.00612 ↗
41. Ghiasi G, Lin T-Y and Le QV. Dropblock: a regularization method for convolutional networks. In: Advances in neural information processing systems , Montreal, Canada. 2–8 December 2018. NIPS. pp.10727–1073.
42. 10.1109/TPAMI.2015.238982410.1109/TPAMI.2015.2389824 ↗
43. 10.1109/CVPR.2018.0091310.1109/CVPR.2018.00913 ↗
44. 10.1016/S0167-8655(98)00140-810.1016/S0167-8655(98)00140-8 ↗
45. 10.1177/152808371349000210.1177/1528083713490002 ↗
46. Gupta G. · Int J Soft Comput (IJSCE) · 2011 · 1 · 304
47. 10.1016/0165-1684(94)90212-710.1016/0165-1684(94)90212-7 ↗
48. 10.13005/bpj/54510.13005/bpj/545 ↗
49. Perez L, Wang J. The effectiveness of data augmentation in image classification using deep learning. arXiv preprint arXiv:171204621 2017.
50. 10.1007/978-3-030-01424-7_5810.1007/978-3-030-01424-7_58 ↗
51. 10.1109/IROS.2018.859406710.1109/IROS.2018.8594067 ↗
52. 10.1109/ACCESS.2020.303534510.1109/ACCESS.2020.3035345 ↗
53. 10.1109/CVPR.2019.0007510.1109/CVPR.2019.00075 ↗
54. 10.1007/978-3-319-10602-1_4810.1007/978-3-319-10602-1_48 ↗
55. 10.1006/rtim.2001.023110.1006/rtim.2001.0231 ↗
56. 10.1177/00405175030730030710.1177/004051750307300307 ↗
57. 10.1177/00405175030730020910.1177/004051750307300209 ↗
58. 10.1016/j.patrec.2010.05.03010.1016/j.patrec.2010.05.030 ↗
59. 10.3390/s2015426010.3390/s20154260 ↗
60. 10.1177/004051751986288010.1177/0040517519862880 ↗
61. 10.1177/155892501989739610.1177/1558925019897396 ↗
62. 10.3390/s1804106410.3390/s18041064 ↗
63. 10.1177/004051752096673310.1177/0040517520966733 ↗
64. Jing J, Wang Z, Ratsch M, et al. Mobile-Unet: efficient convolutional neural network for fabric defect detection. Tex Res J . Online first ahead of print 2020. 0040517530928604.