TAIL: A deep learning framework enhancing fabric hand evaluation through multimodal data fusion
Source abstract
Abstract
Fabric hand, or the tactile properties of fabric, is a vital consideration in textile quality assessment. Traditional evaluation methods, including sensory tests and instrumental assessments, reflect either human perception or objective data, but each has its own limitations. This study introduces Textile Attribute Integration and Learning (TAIL), a deep learning framework that combines numerical data, images, and videos of fabric to evaluate fabric hand comprehensively. TAIL enhances hand scoring prediction, classification, and decision-making by leveraging multimodal data fusion, capturing both human expertise and AI-driven features. Addressing the need for remote fabric evaluation in international trade and virtual environments, TAIL outperforms traditional methods, providing a robust tool for the textile industry. Experimental results confirm its superior accuracy and reliability in fabric quality assessment and decision-making.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Textile materials and evaluations · Industrial Vision Systems and Defect Detection · Color Science and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Donghua University
University of Lille, ENSAIT, Gemtex-Génie et Matériaux Textiles, France
Funding
China Scholarship Council
References (32)
Show source-provided references
1. 10.1080/15440478.2021.188168710.1080/15440478.2021.1881687 ↗
2. 10.1177/00405175940640100810.1177/004051759406401008 ↗
3. 10.1177/004051751243812610.1177/0040517512438126 ↗
4. 10.1108/0955622951008714610.1108/09556229510087146 ↗
5. 10.1080/0040500890865918410.1080/00405008908659184 ↗
6. 10.1177/00405175990690011010.1177/004051759906900110 ↗
7. 10.1108/RJTA-04-2021-004610.1108/RJTA-04-2021-0046 ↗
8. 10.1088/1757-899X/254/17/17202910.1088/1757-899X/254/17/172029 ↗
9. 10.1177/0040517521102144210.1177/00405175211021442 ↗
10. 10.1109/MNET.2024.337790910.1109/MNET.2024.3377909 ↗
11. 10.2991/ijcis.11.1.2610.2991/ijcis.11.1.26 ↗
12. 10.1177/004051751348562210.1177/0040517513485622 ↗
13. Xue Z Zeng X Koehl L et al. Development of a fuzzy inclusion measure for investigating relations between visual and tactile perception of textile products. In: 2012 IEEE international conference on multisensor fusion and integration for intelligent systems (MFI) Hamburg Germany 13–15 September 2012 pp. 108–113. Piscataway NJ: IEEE.10.1109/MFI.2012.6342995 ↗
14. 10.4188/jte.68.2110.4188/jte.68.21 ↗
15. Yuan W Wang S Dong S et al. Connecting look and feel: Associating the visual and tactile properties of physical materials. In: Proceedings of the IEEE conference on computer vision and pattern recognition Honolulu HI USA 21–26 July 2017 pp. 5580–5588. Piscataway NJ: IEEE.
16. Xu S, Xu H, Mao F, et al. Flexible material quality assessment based on visual–tactile fusion. IEEE Trans Instrum Meas 2024; 73: 5017810. DOI: 10.1109/TIM.2024.3386205.
17. Gao Y Hendricks LA Kuchenbecker KJ et al. Deep learning for tactile understanding from visual and haptic data. In: 2016 IEEE international conference on robotics and automation (ICRA) (ed A Okamura A Menciassi A Ude et al.) Stockholm Sweden 16–21 May 2016 pp. 536–543. Piscataway NJ: IEEE.10.1109/ICRA.2016.7487176 ↗
18. 10.1177/00405175510210100210.1177/004051755102101002 ↗
19. 10.1177/0040517523116760510.1177/00405175231167605 ↗
20. Bouman KL Xiao B Battaglia P et al. Estimating the material properties of fabric from video. In: 2013 IEEE International Conference on Computer Vision Sydney Australia 1–8 December 2013 pp. 1984–1991. Piscataway NJ: IEEE.10.1109/ICCV.2013.455 ↗
21. Lea C Flynn MD Vidal R et al. Temporal convolutional networks for action segmentation and detection. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Honolulu HI USA 21–26 July 2017 pp. 156–165. Piscataway NJ: IEEE.10.1109/CVPR.2017.113 ↗
22. Farha YA Gall J. MS-TCN: Multi-stage temporal convolutional network for action segmentation. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Long Beach CA USA 21–26 July 2017 pp. 3575–3584. Piscataway NJ: IEEE.
23. 10.1007/s00521-021-05958-z10.1007/s00521-021-05958-z ↗
24. 10.1109/22.34809010.1109/22.348090 ↗
25. Yu F, Koltun V. Multi-scale context aggregation by dilated convolutions. arXiv 2015: 151107122.
26. 10.1142/S021848859800009410.1142/S0218488598000094 ↗
27. Szegedy C Ioffe S Vanhoucke V et al. Inception-v4 Inception-ResNet and the impact of residual connections on learning. In: AAAI’17: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence San Francisco CA USA 4–9 February 2017 pp. 4278–4284. Palo Alto CA: AAAI Press.10.1609/aaai.v31i1.11231 ↗
28. Agarap AF. Deep learning using rectified linear units (ReLU). arXiv 2018: 180308375.
29. Vaswani A Shazeer N Parmar N et al. Attention is all you need. In: Advances in neural information processing systems 30 (NIPS 2017) (ed I Guyon U Von Luxburg S Bengio et al.) Long Beach CA USA 4–9 December 2017 pp. 6000–6010. Red Hook NY: Curran Associates Inc.
30. Luong M-T, Pham H, , andManning CD. Effective approaches to attention-based neural machine translation. arXiv 2015: 150804025.
31. 10.1007/s42979-023-02343-610.1007/s42979-023-02343-6 ↗
32. 10.1016/j.neucom.2021.03.09110.1016/j.neucom.2021.03.091 ↗