AttCloth-GAN: an improved attention-based conditional generative adversarial network for extracting clothing from specified body part categories in full-body model images
Source abstract
Abstract
Purpose People are often drawn to models' attractive clothing, which sparks their desire to search for and purchase such items. However, consumer preferences vary – some favor full outfits, while others focus only on lower garments. Tiled clothing images greatly boost search success rates. Thus, we propose an improved attention-based conditional GAN to generate such tiled images, which can produce clear, accurate, category-compliant results from models' full-body images. Design/methodology/approach We propose a two-stage framework, where the first stage generates coarse images and the second stage generates fine images: Stage 1 employs CBAM attention to enhance skip connections in U-Net, suppressing irrelevant information like human bodies while sharing low-level features. Labels are concatenated at the bottleneck layer to specify the generated clothing category. We modified the original residual blocks by integrating CBAM attention into them and applying this to Stage 2 of our model, mitigating gradient vanishing while further suppressing irrelevant information. The improved network, termed AttCloth-GAN, can generate clothing images of specified categories. Findings Experimental results demonstrate that our method achieves optimal performance while generating images that align with category labels. On the dresscode dataset, our model improves upon pix2pixHD by 3.0% in SSIM and reduces FID by 10.0%. Originality/value Our proposed method can convert full-body model images into tiled clothing images of specified categories, meeting diverse user needs. Users can extract clothing from their preferred body parts for retrieval, significantly enhancing search accuracy and effectively promoting the development of online clothing shopping.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Generative Adversarial Networks and Image Synthesis · 3D Shape Modeling and Analysis · Face recognition and analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Textile Science and Engineering, Jiangnan University , ,
Jiangnan University , ,
School of Digital Technology and Innovation Design, Jiangnan University , ,
References (39)
Show source-provided references
1. Sca-cnn: spatial and channel-wise attention in convolutional networks for image captioning
2. Viton-hd: high-resolution virtual Try-on via misalignment-aware normalization
3. Dual attention network for scene segmentation
4. Generative adversarial nets
5. Fashion-tile: a tiled clothing image generation model based on improved conditional generative adversarial network10.1108/ijcst-05-2024-0115 ↗
6. An image-based virtual Try-on network
7. Squeeze-and-excitation networks
8. Image-to-image translation with conditional adversarial networks
9. Photo-realistic single image super-resolution using a generative adversarial network
10. Virtual Try-on with pose-garment keypoints guided inpainting
11. A dataset for view-invariant clothing retrieval and attribute prediction
12. Deepfashion: powering robust clothes recognition and retrieval with rich annotations
13. Toward AI fashion design: an attribute-gan model for clothing match10.1016/j.neucom.2019.03.011 ↗
14. Collocating clothes with generative adversarial networks cosupervised by categories and attributes: a multidiscriminator framework10.1109/tnnls.2019.2944979 ↗
15. Distinctive image features from scale-invariant keypoints10.1023/b:visi.0000029664.99615.94 ↗
16. Scscn: a separated channel-spatial convolution net with attention for single-view reconstruction10.1109/tie.2019.2950866 ↗
17. Mirza, M. and Osindero, S. (2014), “Conditional generative adversarial nets”, arxiv Preprint, arxiv:1411.1784.
18. Dress code: high-resolution multi-category virtual Try-on
19. Conditional image synthesis with auxiliary classifier gans
20. Radford, A., Metz, L. and Chintala, S. (2015), “Unsupervised representation learning with deep convolutional generative adversarial networks”, arxiv Preprint, arxiv:1511.06434.
21. Shen, L., Huang, R. and Wang, Z. (2024), “Igr: improving diffusion model for garment restoration from person image”, arxiv Preprint, arxiv:2412.11513.
22. Anime-to-real clothing: cosplay costume generation via image-to-image translation10.1007/s11042-022-12576-x ↗
23. Velioglu, R., Bevandic, P., Chan, R. and Hammer, B. (2024), “Tryoffdiff: virtual-try-off via high-fidelity garment reconstruction using diffusion models”, arxiv Preprint, arxiv:2411.18350.
24. High-resolution image synthesis and semantic manipulation with conditional gans
25. Non-local neural networks
26. Enhanced super-resolution generative adversarial networks
27. Convolutional block attention module
28. Xarchakos, I. and Koukopoulos, T. (2024), “Tryoffanyone: tiled cloth generation from a dressed person”, arxiv Preprint, arxiv:2412.08573.
29. Gp-vton: towards general purpose virtual Try-on via collaborative local-flow global-parsing learning
30. Learning a generative model for fusing infrared and visible images via conditional generative adversarial network with dual discriminators
31. Texture-preserving diffusion models for high-fidelity virtual Try-on
32. Tilegan: category-oriented attention-based high-quality tiled clothes generation from dressed person10.1007/s00521-020-04928-1 ↗
33. Sigmoid loss for language image pre-training
34. Image super-resolution using very deep residual channel attention networks
35. Self-attention generative adversarial networks
36. Cascadegan: a category-supervised cascading generative adversarial network for clothes translation from the human body to tiled images10.1016/j.neucom.2019.11.085 ↗
37. Unpaired image-to-image translation using cycle-consistent adversarial networks
38. Be your own prada: fashion synthesis with structural coherence
39. Single-image dehazing via compositional adversarial network10.1109/tcyb.2019.2955092 ↗