StylishGAN: Toward Fashion Illustration Generation
Source abstract
Abstract
In this article, we propose StylishGAN, a generative adversarial network that generates a fashion illustration sketch given an actual photo of a human model. The generated stylish sketches not only capture the image style from real photos to hand drawings with a cleaner background, but also adjust model’s body into a perfectly proportioned shape. StylishGAN learns proportional transformation and texture information through a proposed body-shaping attentional module. Furthermore, we introduce a contextual fashionable loss that augments the design details, especially the fabric texture, of the clothing. To implement our method, we prepare a new fashion dataset, namely, StylishU, that consists of 3578 paired photo–sketch images. In each pair, we have one real photo collected from the fashion show and one corresponding illustration sketch created by professional fashion illustrators. Extensive experiments show the performance of our method qualitatively and quantitatively.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Generative Adversarial Networks and Image Synthesis · Computer Graphics and Visualization Techniques · 3D Shape Modeling and Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
The Hong Kong Polytechnic Univeristy, Kowloon, Hong Kong
Funding
InnoHK Research Clusters, Hong Kong SAR Government.
References (49)
Show source-provided references
1. 10.5850/JKSCT.2009.33.4.64410.5850/JKSCT.2009.33.4.644 ↗
2. Blackman C. · 2007
3. Choi J. · Fash Text Res J · 2009 · 11 · 867877
4. Hu Z · 10501
5. Zhu Z · 2347
6. Ma L, Jia X, Sun Q, et al. Pose guided person image generation. In: Advances in neural information processing systems, Long Beach, CA, 4–9 December 2017, pp. 406–416, https://ink.library.smu.edu.sg/cgi/viewcontent.cgi?article=5461&context=sis_research
7. Wang X · 7794
8. 10.1145/2010324.196496310.1145/2010324.1964963 ↗
9. Liu M · 700
10. Choi Y · 8789
11. Karras T · 4401
12. Zhu J · 2223
13. Yi Z · 2849
14. Kim J, Kim M, Kang H, et al. U-GAT-IT: Unsupervised generative attentional networks with adaptive layer-instance normalization for imageto-image translation. arxiv:1907.10830, 2019.
15. Zhu J · 465
16. 10.1007/978-3-030-01246-5_310.1007/978-3-030-01246-5_3 ↗
17. 10.1007/978-3-030-01219-9_1110.1007/978-3-030-01219-9_11 ↗
18. Wang T · 8798
19. Larsson G · 577
20. 10.1109/CVPR.2018.0057910.1109/CVPR.2018.00579 ↗
21. Zhang R · 649
22. Luan F · 4990
23. Li Y · 386
24. Gatys LA · 2414
25. 10.1109/ICCV.2019.0091410.1109/ICCV.2019.00914 ↗
26. 10.1109/ICCV.2019.0106410.1109/ICCV.2019.01064 ↗
27. 10.1109/ICCV.2019.0051510.1109/ICCV.2019.00515 ↗
28. 10.1109/ICCV.2019.0045810.1109/ICCV.2019.00458 ↗
29. Isola P · 1125
30. Xian W · 8456
31. Jiang S, Fu Y. Fashion style generator. In: International joint conference on artificial intelligence, Melbourne, VIC, Australia, 19–25 August 2017, pp. 3721–3727, https://www.ijcai.org/proceedings/2017/52010.24963/ijcai.2017/520 ↗
32. Issenhuth T · arXiv · 2019
33. Dong H · arXiv · 2019
34. Wang B · 589
35. Zanfir M · 5391
36. Wu Z · 293
37. Han X · 7543
38. Raj A · 679
39. Dong H · arXiv · 2019
40. Johnson J · 694
41. Mechrez R · 768
42. 10.1109/TIT.1967.105396410.1109/TIT.1967.1053964 ↗
43. Kingma DP · arXiv · 2014
44. Cao Z · 7291
45. Salimans T · 2234
46. 10.1109/TIP.2003.81986110.1109/TIP.2003.819861 ↗
47. Szegedy C · 2818
48. Liu Z · 1096
49. Zou X · 296