journal article·2021-10

The exploration of artificial intelligence application in fashion trend forecasting

Mengyun Shi, Cali Chussid, Pinyi Yang, Menglin Jia, Van Dyk Lewis, Wei Cao

Textile Research Journal· Volume 91· Issue 19-20
Publisher page

Abstract

Fashion trends today are changing much faster than ever before. Timely and reliable trend forecasting is, therefore, critical in the fashion industry. Traditional fashion forecasting requires professionals to abstract image-based information across design collections and time intervals from around the world, which is extremely time-consuming and labor intensive. Considering the financial cost associated with manual labeling and the accuracy of classifications based upon human subjective judgment, this explorative study proposes a data-driven quantitative abstracting approach using an artificial intelligence (A.I.) algorithm. Firstly, an A.I. model was trained to be familiar with fashion images from a large-scale dataset under different scenarios such as online stores and street snapshots; secondly, the model could detect garments and classify clothing attributes such as fabric textures, garment style, and design details from runway photos and videos; thirdly, the model could summarize fashion trends from the attributes it developed. The adoption of an A.I. algorithm proved to be an objective and systematic computerized method of interpreting fashion dynamics in a more efficient, accurate, sustainable, and cost-effective way.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Fashion and Cultural Textiles · Generative Adversarial Networks and Image Synthesis · 3D Shape Modeling and Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Fiber Science & Apparel Design, Cornell University, USA

Department of Statistics, University of California, Los Angeles, USA

Department of Information Science, Cornell University, USA

Department of Family and Consumer Sciences, California State University, USA

References (76)

Show source-provided references
1. Banks L. How to Tell the Fashion Future? New York Times [internet], 26 Aug 2013, www.nytimes.com/2013/08/27/fashion/how-to-tell-the-fashion-future.html
2. Fiore AM · 1997
3. Bloomsbury Publishing. Fashion Forecasting, https://www.bloomsbury.com/uk/fashion-forecasting-9781563678202/ (accessed 24 March 2021).
4. Ren S · Adv Neural Inf Process Syst · 2015 · 91
5. Bossard L, Dantone M, Leistner C, et al. Apparel classification with style. In: Asian conference on computer vision , 2012, pp. 321–335. Berlin, Heidelberg: Springer.10.1007/978-3-642-37447-0_25 ↗
6. Pont-Tuset J. CVPR 2015: Is deep learning in fashion? Scraping vision papers, jponttuset.github.io/deep-learning-scraping/ (accessed 10 November 2019).
7. Hidayati SC, Hua K-L, Cheng W-H, et al. What are the fashion trends in New York? In: Proceedings of the 22nd ACM international conference on multimedia , 2014, pp. 197–200. New York, USA: ACM.10.1145/2647868.2656405 ↗
8. Vittayakorn S, Yamaguchi K, Berg AC, et al. Runway to realway: visual analysis of fashion. In: IEEE Winter Conference on applications of computer vision (WACV ), 5–9 Jan 2015, pp. 951–958. Piscataway, NJ: IEEE.10.1109/WACV.2015.131 ↗
9. Bourdev L, Maji S, Malik J. Describing people: a poselet-based approach to attribute classification. In: IEEE international conference on computer vision, ICCV , Barcelona, Spain, 2011, pp. 1543–1550. Piscataway, NJ: IEEE.10.1109/ICCV.2011.6126413 ↗
10. Chen H, Gallagher A, Girod B. Describing clothing by semantic attributes. In: European conference on computer vision , 2012, pp. 609–623. Berlin, Heidelberg: Springer.10.1007/978-3-642-33712-3_44 ↗
11. Di W, Wah C, Bhardwaj A, et al. Style finder: fine-grained clothing style detection and retrieval. In: IEEE Conference on computer vision and pattern recognition workshops (CVPRW) , 2013, pp. 8–13. Piscataway, NJ: IEEE.10.1109/CVPRW.2013.6 ↗
12. Simo-Serra E, Fidler S, Moreno-Noguer F, et al. A high performance CRF model for clothes parsing. In: Asian conference on computer vision , 2014, pp. 64–81. Berlin, Heidelberg: Springer.10.1007/978-3-319-16811-1_5 ↗
13. Yamaguchi K, Hadi Kiapour M, Berg TL. Paper doll parsing: Rrtrieving similar styles to parse clothing items. In: Proceedings of the IEEE international conference on computer vision , 2013, pp. 3519–3526. Piscataway, NJ: IEEE.10.1109/ICCV.2013.437 ↗
14. Yamaguchi K, Kiapour MH, Ortiz LE, et al. Parsing clothing in fashion photographs. In: IEEE conference on computer vision and pattern recognition (CVPR) , 2012, pp. 3570–3577. Piscataway, NJ: IEEE.10.1109/CVPR.2012.6248101 ↗
15. Liu Z, Luo P, Qiu S, et al. Deepfashion: Powering robust clothes recognition and retrieval with rich annotations. In: Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp.1096–1104. Piscataway, NJ: IEEE.10.1109/CVPR.2016.124 ↗
16. 10.1016/j.ipm.2020.10227610.1016/j.ipm.2020.102276 ↗
17. Di W, Wah C, Bhardwaj A, et al. Style finder: fine-grained clothing style detection and retrieval. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops , 2013, pp. 8-13. Piscataway, NJ: IEEE.10.1109/CVPRW.2013.6 ↗
18. Corbiere C, Ben-Younes H, Ramé A, et al. Leveraging weakly annotated data for fashion image retrieval and label prediction. In: Proceedings of the IEEE international conference on computer vision workshops , 2017, pp. 2268-2274. Piscataway, NJ: IEEE.10.1109/ICCVW.2017.266 ↗
19. Chen H, Gallagher A, Girod B. Describing clothing by semantic attributes. In: European conference on computer vision, 7 October 2012, pp. 609-623. Berlin, Heidelberg: Springer.10.1007/978-3-642-33712-3_44 ↗
20. Zhang N, Paluri M, Ranzato MA, et al. Panda: Pose aligned networks for deep attribute modeling. In: Proceedings of the IEEE conference on computer vision and pattern recognition , 2014, pp. 1637-1644. Piscataway, NJ: IEEE.10.1109/CVPR.2014.212 ↗
21. Yamaguchi K, Okatani T, Sudo K, et al. Mix and match: joint model for clothing and attribute recognition. Proceedings of BMVC 2015, Vol. 1, No. 2, p. 4. Swansea, UK: BMVA Press,10.5244/C.29.51 ↗
22. 10.1109/TPAMI.2017.273184210.1109/TPAMI.2017.2731842 ↗
23. Han X, Wu Z, Huang PX, et al. Automatic spatially- aware fashion concept discovery. In: IEEE international conference on computer vision (ICCV) , 2017, pp. 1472–1480. Piscataway, NJ: IEEE.10.1109/ICCV.2017.163 ↗
24. Singh KK · ECCV · 2016 · 6 · 753
25. Jia M, Zhou Y, Shi M, et al. A deep-learning-based fashion attributes detection model. arXiv preprint arXiv:1810.10148. 24 Oct 2018.
26. Chen Q, Huang J, Feris R, et al. Deep domain adaptation for describing people based on fine-grained clothing attributes. In: IEEE conference on computer vision and pattern recognition (CVPR) , 2015, pp. 5315–5324. Piscataway, NJ: IEEE.10.1109/CVPR.2015.7299169 ↗
27. Dong Q, Gong S, Zhu X. Multi-task curriculum transfer deep learning of clothing attributes. In: IEEE winter conference on applications of computer vision (WACV) , 2017, pp. 520–529. Piscataway, NJ: IEEE.10.1109/WACV.2017.64 ↗
28. Hadi Kiapour M, Han X, Lazebnik S,et al. Where to buy it: matching street clothing photos in online shops. Proceedings of the IEEE international conference on computer vision , 2015, pp. 3343–3351. Piscataway, NJ: IEEE.10.1109/ICCV.2015.382 ↗
29. Ma Y, Jia J, Zhou S, et al. Towards better understanding the clothing fashion styles: a multimodal deep learning approach. Palo Alto, USA: AAAI 2017; 38–44.10.1609/aaai.v31i1.10509 ↗
30. Simo-Serra E, Ishikawa H. Fashion style in 128 floats: joint ranking and classification using weak data for feature extraction. In: Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp. 298-307. Piscataway, NJ: IEEE.10.1109/CVPR.2016.39 ↗
31. Jiang S, Shao M, Jia C, et al. Consensus style centralizing auto-encoder for weak style classification. In: Proceedings of the AAAI conference on artificial intelligence , 21 Feb 2016, Vol. 30, No. 1. Palo Alto, USA: AAAI.10.1609/aaai.v30i1.10157 ↗
32. Hsiao WL, Grauman K. Creating capsule wardrobes from fashion images. In: Proceedings of the IEEE conference on computer vision and pattern recognition , 2018, pp. 7161-7170. Piscataway, NJ: IEEE.10.1109/CVPR.2018.00748 ↗
33. Lee H, Seol J, Lee SG. Style2vec: representation learning for fashion items from style sets. arXiv preprint arXiv:1708.04014. 14 Aug 2017.
34. Vaccaro K, Shivakumar S, Ding Z, et al. The elements of fashion style. In: Proceedings of the 29th annual symposium on user interface software and technology, 16 Oct 2016, pp. 777–785.10.1145/2984511.2984573 ↗
35. Huang J, Feris RS, Chen Q, et al. Cross-domain image retrieval with a dual attribute-aware ranking network. Proceedings of the IEEE international conference on computer vision , 2015, pp. 1062–1070. Piscataway, NJ: IEEE.10.1109/ICCV.2015.127 ↗
36. Huang J, Rathod V, Sun C, et al. Speed/accuracy trade-offs for modern convolutional object detectors. In: Proceedings of the IEEE conference on computer vision and pattern recognition , 2017, pp. 7310–7311. Piscataway, NJ: IEEE.10.1109/CVPR.2017.351 ↗
37. Matzen K, Bala K, Snavely N. Streetstyle: exploring world-wide clothing styles from millions of photos. ArXiv: 1 70 6. 01869 . Epub ahead of print 2017.
38. Cheng Z-Q, Wu X, Liu Y, et al. Video2Shop: exact matching clothes in videos to online shopping images. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR) , 2017, pp. 4169–4177. Piscataway, NJ: IEEE.10.1109/CVPR.2017.444 ↗
39. Al-Halah Z, Stiefelhagen R, Grauman K. Fashion forward: forecasting visual style in fashion. In: Proceedings of the IEEE international conference on computer vision , 2017, pp. 388–397. Piscataway, NJ: IEEE.10.1109/ICCV.2017.50 ↗
40. Song Z, Wang M, Hua X-S, et al. Predicting occupation via human clothing and contexts . ICCV 2011; 1084–1091.10.1109/ICCV.2011.6126355 ↗
41. Kwak IS, Murillo AC, Belhumeur PN, et al. From bikers to surfers: visual recognition of urban tribes. In: British machine vision conference , September 2013, Vol. 1, p. 2. Swansea, UK: BMVA Press.10.5244/C.27.14 ↗
42. Chen K-T, Luo J. When fashion meets big data: discriminative mining of best-selling clothing features . WWW (companion volume) 2017; 15–22.10.1145/3041021.3054141 ↗
43. He R, McAuley J. Ups and downs: modeling the visual evolution of fashion trends with one-class collaborative filtering. Proceedings of the 25th international conference on world wide web , 2016, pp. 507–517. International World Wide Web Conferences Steering Committee.10.1145/2872427.2883037 ↗
44. Song Z, Wang M, Hua X-S, et al. Predicting occupation via human clothing and contexts. ICCV 2011; 1084–1091.10.1109/ICCV.2011.6126355 ↗
45. Rostamzadeh N, Hosseini S, Boquet T, et al. Fashion-gen: the generative fashion dataset and challenge. arXiv preprint arXiv:1806.08317. 21 Jun 2018.
46. Zou X, Kong X, Wong W, et al. Fashionai: a hierarchical dataset for fashion understanding. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops , 2019. Piscataway, NJ: IEEE10.1109/CVPRW.2019.00039 ↗
47. Ge Y, Zhang R, Wang X, et al. Deepfashion2: a versatile benchmark for detection, pose estimation, segmentation and re-identification of clothing images. In: Proceedings of the IEEE conference on computer vision and pattern recognition , 2019, pp. 5337-5345. Piscataway, NJ: IEEE.10.1109/CVPR.2019.00548 ↗
48. Zheng S, Yang F, Kiapour MH, et al. Modanet: a large-scale street fashion dataset with polygon annotations. In: Proceedings of the 26th ACM international conference on multimedia , 15 Oct 2018, pp. 1670–1678. New York, USA: ACM.10.1145/3240508.3240652 ↗
49. Ji X, Wang W, Zhang M, et al. Cross-domain image retrieval with attention modeling. ArXiv:1709.01784. Epub ahead of print 2017.10.1145/3123266.3123429 ↗
50. Kuo Y-H, Hsu WH. Feature learning with rank-based candidate selection for product search. Proceedings of the IEEE conference on computer vision and pattern recognition , 2017, pp. 298–307. Piscataway, NJ: IEEE.10.1109/ICCVW.2017.44 ↗
51. Wang X, Sun Z, Zhang W, et al. Matching user photos to online products with robust deep features. Proceedings of the 2016 ACM on international conference on multimedia retrieval , 2016, pp. 7–14. New York, USA: ACM.10.1145/2911996.2912002 ↗
52. Vogue. Summer 2018 fashion trends: Summer dresses’ styles and patterns. Vogue [magazine on the internet]. 13 April 2018, www.vogue.it/en/fashion/trends/2018/04/13/summer-2018-fashion-trends-summer-dresses-styles-patterns/
53. Vogue. The ten color trends for Spring Summer 2018. Vogue [magazine on the internet]. 12 January 2018, www.vogue.it/en/fashion/trends/2018/01/12/the-ten-color-trends-for-spring-summer-2018/
54. Vogue. 10 Top Trends for Spring Summer 2018. Vogue [magazine on the internet], www.vogue.it/en/fashion/trends/2017/10/04/best-trend-fashion-spring-summer-2018/?refresh_ce=
55. ELLE. ELLE.Com's Comprehensive Guide To The Biggest Trends Of Spring 2018. Elle [magazine on the internet], www.elle.com/fashion/trend-reports/g12205305/spring-fashion-trends-2018/
56. He K, Zhang X, Ren S, et al. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp. 770-778. Piscataway, NJ: IEEE.10.1109/CVPR.2016.90 ↗
57. Tensorflow. Available from: www.tensorflow.org/
58. Supplementary information of dataset modification and model structure, https://textile-research-journal.s3.amazonaws.com/Supplementary+Information.pdf
59. Lin T-Y, Maire M, Belongie S, et al. Microsoft coco: common objects in context. In: European conference on computer vision , 2014, pp. 740–755. Berlin, Heidelberg: Springer.10.1007/978-3-319-10602-1_48 ↗
60. Delectron. Available from: https://github.com/facebookresearch/detectron
61. Vogue. 20 trends for Spring/Summer 2018. Vogue [magazine on the internet], www.vogue.fr/fashion/fashion-inspiration/diaporama/fwss18-spring-summer-2018-fashion-trends/46478
62. Vogue. The Top Trends of Spring/Summer 2018. Vogue [magazine on the internet], www.vogue.co.uk/gallery/spring-summer-2018-trends
63. Harper’s Bazaar. The top spring 2018 runway trends to know. Harper’s Bazaar [magazine on the internet], www.harpersbazaar.com/fashion/trends/g12176306/spring-2018-fashion-trends/
64. Python. Available from: https://www.python.org/
65. Pandas. Available from: https://pandas.pydata.org/
66. Matplotlib. Available from: https://matplotlib.org/
67. Du X, Lin TY, Jin P, et al. Spinenet: learning scale-permuted backbone for recognition and localization. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2020, pp. 11592–11601. Piscataway, NJ: IEEE.10.1109/CVPR42600.2020.01161 ↗
68. Google AI Blog. Advancing self-supervised and semi-supervised learning with SimCLR, https://ai.googleblog.com/2020/04/advancing-self-supervised-and-semi.html (accessed 8 April 2020).
69. Google AI Blog. Open Sourcing BERT: state-of-the-art pre-training for natural language processing, http://ai.googleblog.com/2018/11/open-sourcing-bert-state-of-art-pre.html (accessed 20 April 2019).
70. Jia M, Shi M, Sirotenko M, et al. Fashionpedia: ontology, segmentation, and an attribute localization dataset. In: European conference on computer vision , 23 Aug, 2020, pp. 316-332. Cham: Springer.10.1007/978-3-030-58452-8_19 ↗
71. He K, Gkioxari G, Dollár P, et al. Mask R-CNN, https://arxiv.org/abs/1703.06870v3 (2017).10.1109/ICCV.2017.322 ↗
72. 10.1162/neco.1997.9.8.173510.1162/neco.1997.9.8.1735 ↗
73. 10.1145/276695910.1145/2766959 ↗
74. Veit A, Belongie S, Karaletsos T. Conditional similarity networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition , 2017, pp. 830-838. Piscataway, NJ: IEEE.10.1109/CVPR.2017.193 ↗
75. Amazon Web Services. Available from: https://aws.amazon.com/
76. Paton E. H&M, a fashion giant, has a problem: $4.3 billion in unsold clothes. The New York Times [newspaper on the internet], 30 March 2018, www.nytimes.com/2018/03/27/business/hm-clothes-stock-sales.html