journal article·2026-01

A novel fuzzy pretrained neural network architecture for image recolorization on textile products

Xuyuan Zhang, Chen Xu, Yu Han

Textile Research Journal· Volume 96· Issue 1-2
Publisher page

Abstract

An image recolorization task aims to generate synthetic color images on computers specifically for fabric color design proposals. To enhance processing efficiency and better preserve the original geometric and textile structures, this work proposes a novel fuzzy pretrained neural-network-based image recolorization architecture for fabric and clothing images, consisting of three phases: image decomposition, image segmentation, and image reconstruction. Intrinsic image components, which are initially estimated using a pretrained neural network VOS-Net, formulate an optimization process to achieve high-quality reflectance and shading images. The plug-and-play denoiser network DRU-Net is integrated to smooth these components. The image segmentation phase, which is grounded in the piecewise constant assumption and fuzzy membership functions, partitions image regions to be recolored through only one computation. Recolored images expressed through analytical solutions are produced using the given color palette. Numerical results demonstrate that, compared with classical model-driven methods, our model-data-driven method shows superior efficiency, achieving a remarkable 34.73% reduction in runtime. In terms of quantitative analysis, the proposed method excels at preserving original texture structures and yarn edges with better performance of Learned Perceptual Image Patch Similarity (LPIPS) and structural similarity (SSIM) scores. Furthermore, the color palette distance as an evaluation metric of recoloring indicates that the proposed method effectively reduces the color distortion and color leakage, and the color presentation are closer to the given color palette.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Color Science and Applications · Image Enhancement Techniques · Spectroscopy and Chemometric Analyses

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Electronics and Information Engineering, Shenzhen University, 3688 Nanhai Avenue, Nanshan District, Shenzhen, China.

Funding

Natural Science Foundation of Guangdong Province · National Natural Science Foundation of China · Project of Educational Commission of Guangdong Province · Shenzhen Basis Research Project

References (35)

Show source-provided references
1. 10.1177/0040517522110361610.1177/00405175221103616 ↗
2. 10.1007/s00371-022-02595-y10.1007/s00371-022-02595-y ↗
3. Sun S Li X Li J. UCCTGAN: unsupervised clothing color transformation generative adversarial network. In 2020 25th International Conference on Pattern Recognition (ICPR) Milan Italy 10–15 January 2021 pp. 1582–1589.10.1109/ICPR48806.2021.9412002 ↗
4. Zhang Y, Chen N, Qi S, et al. Detection of recolored image by texture features in chrominance components. ACM Trans Multimedia Comput Commun Appl 2023; 19(3): 1–23.10.1145/3571076 ↗
5. 10.1007/s11042-023-15114-510.1007/s11042-023-15114-5 ↗
6. 10.1007/s41095-021-0245-510.1007/s41095-021-0245-5 ↗
7. 10.1145/3272127.327505410.1145/3272127.3275054 ↗
8. 10.1002/col.2274510.1002/col.22745 ↗
9. 10.1109/TVCG.2023.329638610.1109/TVCG.2023.3296386 ↗
10. Zhang X, Xu C, Han Y, et al. Fabric image recolorization by fuzzy pretrained neural network. Vis Comput 2024.
11. Cho J Yun S Lee K et al. PaletteNet: image recolorization with given color palette. In 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) Honolulu HI USA 21–26 July 2017 pp. 1058–1066.10.1109/CVPRW.2017.143 ↗
12. Li B Belongie S Lim SN et al. Neural image recolorization for creative domains. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) New Orleans LA USA 19–20 June 2022 pp. 2225–222910.1109/CVPRW56347.2022.00242 ↗
13. 10.1007/s00500-022-07483-010.1007/s00500-022-07483-0 ↗
14. Nazeri K Ng E Ebrahimi M. Image colorization using generative adversarial networks. In International Conference on Articulated Motion and Deformable Objects (AMDO) Palma de Mallorca Spain 12–13 July 2018 pp. 85-94.10.1007/978-3-319-94544-6_9 ↗
15. Kim H Kim J Kim J. Infrared image colorization network using variational AutoEncoder. In 2021 36th International Technical Conference on Circuits/Systems Computers and Communications (ITC-CSCC) Jeju Korea (South) 27–30 June 2021 pp. 1–4.10.1109/ITC-CSCC52171.2021.9605698 ↗
16. Kiani L Saeed M Nezamabadi-pour H. Image colorization using generative adversarial networks and transfer learning. In 2020 International Conference on Machine Vision and Image Processing (MVIP) Iran Iran 18–20 February 2020 pp. 1-6.10.1109/MVIP49855.2020.9116882 ↗
17. 10.1145/276697810.1145/2766978 ↗
18. 10.1007/s10044-024-01228-510.1007/s10044-024-01228-5 ↗
19. Kang JM Hwang Y. Hierarchical palette extraction based on local distinctiveness and cluster validation for image recoloring. In 2018 25th IEEE International Conference on Image Processing (ICIP) Athens Greece 7–10 October 2018 pp. 2252-2256.10.1109/ICIP.2018.8451526 ↗
20. 10.1109/TMM.2016.260800010.1109/TMM.2016.2608000 ↗
21. 10.1177/004051751881705110.1177/0040517518817051 ↗
22. Liu X Zhu L Xu S et al. Palette-based recoloring of natural images under different illumination. In 2021 IEEE 6th International Conference on Computer and Communication Systems (ICCCS) Chengdu China 23–26 April 2021 pp. 347–351.10.1109/ICCCS52626.2021.9449228 ↗
23. 10.1080/13682199.2020.178308810.1080/13682199.2020.1783088 ↗
24. 10.1109/TCSVT.2022.319942810.1109/TCSVT.2022.3199428 ↗
25. Li Q, Guo J, Wu Z, et al. Reflectance edge guided networks for detail-preserving intrinsic image decomposition. Sci China Inf Sci 2023; 66: 1–16.
26. Das P Karaoglu S Gevers T. PIE-Net: photometric invariant edge guided network for intrinsic image decomposition. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) New Orleans LA USA 18–24 June 2022 pp. 19758-19767.10.1109/CVPR52688.2022.01917 ↗
27. 10.1145/363075010.1145/3630750 ↗
28. 10.1109/TPAMI.2021.308891410.1109/TPAMI.2021.3088914 ↗
29. Zoran D Isola P Krishnan D et al. Learning ordinal relationships for mid-level vision. In 2015 IEEE International Conference on Computer Vision (ICCV) Santiago Chile 7–13 December 2015 pp. 388-396.10.1109/ICCV.2015.52 ↗
30. Xie S Girshick R Dollár P et al. Aggregated residual transformations for deep neural networks. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Honolulu HI USA 21–26 July 2017 pp. 5987–5995.10.1109/CVPR.2017.634 ↗
31. Tan M Le QV. EfficientNet: rethinking model scaling for convolutional neural networks. In 2019 36th International Conference on Machine Learning (ICML) Long Beach CA USA 9–15 June 2019 pp. 6105–6114.
32. Liu Z Luo P Qiu S et al. DeepFashion: powering robust clothes recognition and retrieval with rich annotations. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Las Vegas NV USA 27–30 June 2016 pp. 1096–1104.10.1109/CVPR.2016.124 ↗
33. 10.1145/2010324.196495810.1145/2010324.1964958 ↗
34. Zhang R Isola P Efros AA et al. The unreasonable effectiveness of deep features as a perceptual metric. In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Salt Lake City UT USA 18–23 June 2018 pp. 586–595.10.1109/CVPR.2018.00068 ↗
35. CompuPhase. Colour Metric. https://www.compuphase.com/cmetric.htm (accessed 28 March 2024).