journal article·2025-06-12

Fashion-tile: a tiled clothing image generation model based on improved conditional generative adversarial network

Meihua Gu, Yalu Chu, Xiaoxiao Dong

Publisher page

Abstract

Purpose Clothing retrieval and matching tasks require the use of model clothing images as input. Due to the limitation of shooting postures and angles, direct using of model images for clothing retrieval or matching often faces many challenges. In view of this, this paper aims to propose a novel tiled clothing image generation model based on improved conditional generative adversarial network (GAN) that can generate clear and accurate tiled clothing images from selected model images. Design/methodology/approach Aiming at the problems of local information loss and overall structure inaccuracy in tile clothing image generation, this paper optimizes pix2pixHD network model from three aspects: using spatial transformer network (STN) for spatial invariance optimization, using atrous spatial pyramid pooling (ASPP) for feature extraction optimization, using self-attention (SA) for global context information acquisition optimization. The improved network model is called fashion-tile, which can improve the quality and fidelity of tile clothing image generation. Findings The experimental results show that the proposed method is obviously superior to the existing methods not only in the evaluation metrics, but also in the generating clothing image quality and fidelity. The peak signal-to-noise ratio (PSNR) value is increased by at least 6.6%, the structural similarity (SSIM) value is increased by at least 2.1%, and the Fréchet inception distance (FID) value is reduced by at least 8.6% on the person2cloth dataset. Practical implications This work generates high-quality tiled clothing images that enhance the preservation of clothing details and structures, providing consumers with a clearer and more realistic visual experience, thereby increasing shopping satisfaction and purchase intention. With continuous technological advancements and deeper application, the proposed method is expected to play a greater role in the future of clothing e-commerce, offering consumers a richer and more authentic shopping experience. Originality/value The proposed method provides an effective solution for generating tiled clothing from model images, which will help to improve the accuracy of subsequent clothing retrieval and matching, and help to enhance the consumers shopping experience and effectively promote sales.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Generative Adversarial Networks and Image Synthesis · 3D Shape Modeling and Analysis · Computer Graphics and Visualization Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (40)

Show source-provided references
1. GANs trained by a two time-scale update rule converge to a local Nash equilibrium10.18034/ajase.v8i1.9 ↗
2. InfoGAN: interpretable representation learning by information maximizing generative adversarial nets
3. DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs10.1109/TPAMI.2017.2699184 ↗
4. Tailorgan: making user-defined fashion designs
5. The improved image inpainting algorithm via encoder and similarity constraint10.1007/s00371-020-01932-3 ↗
6. Stargan: unified generative adversarial networks for multi-domain image-to-image translation10.1109/CVPR.2018.00916 ↗
7. Viton-hd: high-resolution virtual try-on via misalignment-aware normalization10.1109/CVPR46437.2021.01391 ↗
8. FashionGAN: display your fashion design using conditional generative adversarial nets10.1111/cgf.13552 ↗
9. AI assisted apparel design
10. Generative adversarial nets
11. Viton: an image-based virtual try-on network
12. Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B. and Hochreiter, S. (2017), “Gans trained by a two time-scale update rule converge to a local nash equilibrium”, in Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H.M., Fergus, R., Vishwanathan, S.V.N. and Garnett, R. (Eds), Advances in Neural Information Processing Systems, Asian Journal of Applied Science and Engineering, Long Beach, CA, pp. 6629-6640.
13. Multimodal unsupervised image-to-image translation
14. Image-to-image translation with conditional adversarial networks
15. DMSC-GAN: a c-GAN-based framework for super-resolution reconstruction of SAR images10.3390/rs16010050 ↗
16. Feature-aware conditional GAN for category text generation10.1016/j.neucom.2023.126352 ↗
17. Toward AI fashion design: an Attribute-GAN model for clothing match10.1016/j.neucom.2019.03.011 ↗
18. Spatial transformer networks
19. Conditional generative adversarial nets10.48550/arXiv.1411.1784 ↗
20. Single image super-resolution via a holistic attention network
21. Learning fashion compatibility from in-the-wild images
22. Image compression using orthogonal wavelets viewed from peak signal to noise ratio and computation time10.5120/7177-9828 ↗
23. Teaching DNNs to design fast fashion
24. U-net: convolutional networks for biomedical image segmentation
25. CLIPTexture: text-driven texture synthesis10.1145/3503161.3548146 ↗
26. KT-GAN: knowledge-transfer generative adversarial network for text-to-image synthesis10.1109/tip.2020.3026728 ↗
27. Enhancing perceptual loss with adversarial feature matching for super-resolution
28. Mean squared error: love it or leave it? A new look at signal fidelity measures10.1109/MSP.2008.930649 ↗
29. Image quality assessment: from error visibility to structural similarity10.1109/tip.2003.819861 ↗
30. High-resolution image synthesis and semantic manipulation with conditional gans10.1109/CVPR.2018.00917 ↗
31. Stylediffusion: controllable disentangled style transfer via diffusion models
32. ClothGAN: generation of fashionable Dunhuang clothes using generative adversarial networks10.1080/09540091.2020.1822780 ↗
33. Drb-gan: a dynamic resblock generative adversarial network for artistic style transfer10.1109/ICCV48922.2021.00632 ↗
34. Toward intelligent design: an ai-based fashion designer using generative adversarial networks aided by sketch and rendering generators10.1109/tmm.2022.3146010 ↗
35. Sitcom-star-based clothing retrieval for video advertising: a deep learning framework10.1007/s00521-018-3579-x ↗
36. Self-attention generative adversarial networks
37. Text guided person image synthesis
38. Unpaired image-to-image translation using cycle-consistent adversarial networks10.1109/ICCV.2017.244 ↗
39. Toward multimodal image-to-image translation
40. Evaluation and trend of fashion design research: visualization analysis based on CiteSpace10.1186/S40691-022-00316-6 ↗