journal article·2025-12Open access

Micro-KTNet: Microstructure knowledge transfer learning for fiber masterbatch agglomeration recognition

Xianqi Zhang, Bing Wei, Kuangrong Hao, Lei Gao, Ruimin Xie, Huaping Wang

Abstract

Fiber masterbatch production suffers from inherent agglomeration effect of high-concentration color masterbatches, negatively impacting color uniformity, particle dispersion, and thermal stability in fiber masterbatch, and ultimately the quality of fiber products. However, accurately recognizing and classifying the agglomeration in scanning electron microscopy (SEM) images remain a challenge due to the complexity of agglomeration status, difficulty in distinguishing micro-size agglomeration, and limited data availability. To address this challenge, this paper proposes a novel microstructure recognition architecture, named Micro-KTNet, which is designed for segmenting SEM images of fiber masterbatch aggregation. First, Micro-KTNet leverages transferable microstructural features to initialize the proposed network, mitigating the impact of limited data. Then, to handle multi-scale features in the microstructure, an encoding-decoding structure is constructed and skip connections are used to transfer the output features of the encoding layer. Finally, the decoder incorporates a novel attention module to effectively process both global and local features. To evaluate Micro-KTNet, a unique fiber masterbatch SEM database is built as the benchmark for micro-size agglomeration recognition. Experimental results indicate that Micro-KTNet surpasses existing state-of-the-art methods and improves the recognition precision from 75. 37% to 87. 04%.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Optical Sensing Technologies · Industrial Vision Systems and Defect Detection · Optical Network Technologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Engineering Research Center of Digitized Textile & Apparel Technology, Ministry of Education, College of Information Sciences and Technology, Donghua University, Shanghai, P. R. China

Waite Campus, Australia’s Commonwealth Scientific and Industrial Research Organization (CSIRO), Urrbrae, SA, Australia

State Key Laboratory for Modification of Chemical Fibers and Polymer Materials, College of Materials Science and Engineering, Donghua University, Shanghai, P. R. China

Funding

Shanghai Sailing Program · Cultivation Project of Discipline Innovation · Postdoctoral Research Foundation of China

References (57)

Show source-provided references
1. 10.3144/expresspolymlett.2008.8710.3144/expresspolymlett.2008.87 ↗
2. 10.1016/j.ijbiomac.2018.10.09010.1016/j.ijbiomac.2018.10.090 ↗
3. 10.1016/j.eurpolymj.2003.08.00810.1016/j.eurpolymj.2003.08.008 ↗
4. 10.1016/j.compositesa.2005.08.01010.1016/j.compositesa.2005.08.010 ↗
5. 10.1016/j.neucom.2020.06.11710.1016/j.neucom.2020.06.117 ↗
6. 10.1016/j.patrec.2020.07.04210.1016/j.patrec.2020.07.042 ↗
7. 10.1109/TNNLS.2018.287686510.1109/TNNLS.2018.2876865 ↗
8. Garcia-Garcia A, Orts-Escolano S, Oprea S, et al. A review on deep learning techniques applied to semantic segmentation. arXiv preprint arXiv:170406857 2017.10.1016/j.asoc.2018.05.018 ↗
9. 10.1038/s41586-019-1157-810.1038/s41586-019-1157-8 ↗
10. 10.3390/electronics906104810.3390/electronics9061048 ↗
11. 10.1016/j.matpr.2020.11.35110.1016/j.matpr.2020.11.351 ↗
12. 10.1016/j.rcim.2022.10243110.1016/j.rcim.2022.102431 ↗
13. 10.1109/TCDS.2020.297797410.1109/TCDS.2020.2977974 ↗
14. 10.1109/TETCI.2023.330625010.1109/TETCI.2023.3306250 ↗
15. 10.1109/TETCI.2023.330133710.1109/TETCI.2023.3301337 ↗
16. 10.1016/j.ins.2020.06.03510.1016/j.ins.2020.06.035 ↗
17. 10.1016/j.resconrec.2022.10615710.1016/j.resconrec.2022.106157 ↗
18. 10.1007/s40747-023-01070-y10.1007/s40747-023-01070-y ↗
19. 10.3389/fcomp.2021.61398110.3389/fcomp.2021.613981 ↗
20. 10.1109/TETCI.2023.330962610.1109/TETCI.2023.3309626 ↗
21. 10.14504/ajr.8.S1.2010.14504/ajr.8.S1.20 ↗
22. 10.1109/ACCESS.2019.289692010.1109/ACCESS.2019.2896920 ↗
23. Zhang Y, Li K, Li K, et al. Image super-resolution using very deep residual channel attention networks. In: Proceedings of the European conference on computer vision(ECCV), 2018; 286– 301.10.1007/978-3-030-01234-2_18 ↗
24. 10.1007/978-3-031-76235-2_3410.1007/978-3-031-76235-2_34 ↗
25. Ribani R, Marengoni M. A survey of transfer learning for convolutional neural networks. In: 2019 32nd SIBGRAPI conference on graphics, patterns and images tutorials(SIBGRAPI-T), Rio de Janeiro, Brazil, 28–31 October 2019. IEEE, pp. 47–57.10.1109/SIBGRAPI-T.2019.00010 ↗
26. Tan C, Sun F, Kong T, et al. A survey on deep transfer learning. In: Artificial neural networks and machine learning–ICANN 2018: 27th international conference on artificial neural networks, Rhodes, Greece, 4–7 October 2018, Proceedings, Part III 27. Springer, pp. 270–279.10.1007/978-3-030-01424-7_27 ↗
27. Oquab M, Bottou L, Laptev I, et al. Learning and transferring mid-level image representations using convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2014, pp. 1717–1724.10.1109/CVPR.2014.222 ↗
28. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:14091556 2014.
29. Liu F, Shen C, Lin G. Deep convolutional neural fields for depth estimation from a single image. In: Proceedings of the IEEE conference on computer vision and pattern recognition,2015; 5162-5170.10.1109/CVPR.2015.7299152 ↗
30. 10.1016/j.neucom.2022.02.00310.1016/j.neucom.2022.02.003 ↗
31. 10.1038/s41524-022-00878-510.1038/s41524-022-00878-5 ↗
32. Cho K, Van Merri¨enboer B, Gulcehre C, et al. Learning phrase representations using rnn encoder-decoder for statistical machine translation. arXiv preprint arXiv:14061078 2014.10.3115/v1/D14-1179 ↗
33. Wang Z, He W, Wu H, et al. Chinese poetry generation with planning based neural network. arXiv preprint arXiv:161009889 2016.
34. Serban I · A hierarchical latent variable encoder-decoder model for generating dialogues · 2017 · 31
35. 10.1109/IVS.2018.850065810.1109/IVS.2018.8500658 ↗
36. Yasrab R, Gu N, Zhang X. Scnet:A simplified encoder-decoder cnn for semantic segmentation. In: 2016 5th international conference on computer science and network technology (ICCSNT). IEEE, 2016: 785-789.10.1109/ICCSNT.2016.8070266 ↗
37. 10.1109/TPAMI.2016.264461510.1109/TPAMI.2016.2644615 ↗
38. Chen LC, Zhu Y, Papandreou G,et al. Encoder-decoder with atrous separable convolution for semantic image segmentation. In Proceedings of the European conference on computer vision (ECCV). 2018: 801-818.10.1007/978-3-030-01234-2_49 ↗
39. 10.1093/jge/gxy01510.1093/jge/gxy015 ↗
40. Roy AG, Navab N, Wachinger C. Concurrent spatial and channel‘squeeze&excitation’in fully convolutional networks. In: Medical image computing and computer assisted intervention–MICCAI 2018: 21st international conference, Granada, Spain, 16–20 September 2018, Proceedings, Part I. Springer, pp. 421–429.10.1007/978-3-030-00928-1_48 ↗
41. Lin T Y, Dollár P, Girshick R, et al. Feature pyramid networks for object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2017: 2117-2125.10.1109/CVPR.2017.106 ↗
42. Zhao H, Shi J, Qi X, et al. Pyramid scene parsing network. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2017: 2881-2890.10.1109/CVPR.2017.660 ↗
43. Ronneberger O, Fischer P, Brox T. U-net:Convolutional networks for biomedical image segmentation. In: Medical image computing and computer-assisted intervention–MICCAI 2015:18th international conference, Munich, Germany, 5–9 October 2015, Proceedings, part III 18. Springer, pp. 234–241.10.1007/978-3-319-24574-4_28 ↗
44. Chaurasia A, Culurciello E. Linknet:Exploiting encoder representations for efficient semantic segmentation. In: 2017 IEEE visual communications and image processing(VCIP). IEEE, 2017: 1-4.10.1109/VCIP.2017.8305148 ↗
45. Liang J, Sun G, Zhang K, et al. Mutual affine network for spatially variant kernel estimation in blind image super resolution. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. 2021: 4096-4105.10.1109/ICCV48922.2021.00406 ↗
46. 10.1109/TMI.2019.295960910.1109/TMI.2019.2959609 ↗
47. Chen LC, Papandreou G, Schroff F, et al. Rethinking atrous convolution for semantic image segmentation. arXiv preprint arXiv:170605587 2017.10.1007/978-3-030-01234-2_49 ↗
48. Huang G, Liu Z, Van Der Maaten L, et al. Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2017: 4700-4708.10.1109/CVPR.2017.243 ↗
49. Chen Y · Adv Neural Inf Process Syst · 2017 · 30 · 4468
50. Tan M · PMLR · 2019 · 6105
51. 10.1609/aaai.v31i1.1123110.1609/aaai.v31i1.11231 ↗
52. Sandler M, Howard A, Zhu M, et al. Mobilenetv2: inverted residuals and linear bottlenecks. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2018: 4510-4520.10.1109/CVPR.2018.00474 ↗
53. He K, Zhang X, Ren S, et al. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2016: 770-778.10.1109/CVPR.2016.90 ↗
54. Xie S, Girshick R, Dollár P, et al. Aggregated residual transformations for deep neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2017: 1492-1500.10.1109/CVPR.2017.634 ↗
55. Hu J, Shen L, Sun G. Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2018: 7132–7141.10.1109/CVPR.2018.00745 ↗
56. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv Prep. arXiv1409.1556 2014.
57. CholletXception F.: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2017: 1251–1258.10.1109/CVPR.2017.195 ↗