journal article·2022-10-06Open access

High-Accuracy Clothing and Style Classification via Multi-Feature Fusion

Xiaoling Chen, Yun Deng, Cheng Di, Huiyin Li, Guangyu Tang, Hao Cai

Applied Sciences· Volume 12· Issue 19

Abstract

In recent years, the online selection of virtual clothing styles has been used to explore and expand diversified personal aesthetics, and it is also an overall reform and challenge to the clothing industry. Under the condition of the existing clothing style categories, this paper puts forward a style classification method combining fine-grained and coarse-grained techniques. Furthermore, a new deep neural network is proposed, which can improve the robustness of recognition and avoid the interference of image background through the pan learning and the background learning of image features. In order to study the relationship between the fine-grained attributes of clothing and the whole style, firstly, the clothing types are learned to realize the pre-training of model parameters. Secondly, through the transfer learning of the first stage of the pre-training model parameters, the model parameters are fine-tuned to make them more suitable for identifying the coarse-grained style types. Finally, a network structure based on the dual attention mechanism is proposed to improve the accuracy of final identification by adding different attention mechanisms at different stages of the network to enhance the performance of network features. In the experiment, we collected 50,000 images of 10 clothing styles to train and evaluate the models. The results show that the proposed classification method can effectively distinguish clothing styles and types.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Image Enhancement Techniques · Visual Attention and Saliency Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Arts and Media, China University of Geosciences (Wuhan), Wuhan 430070, China

School of Computer Science and Artificial Intelligence, Wuhan Textile University, Wuhan 430200, China

References (38)

Show source-provided references
1. Consumers buying behavior towards Online Shopping—A study of Literature Review10.5958/2321-5763.2018.00076.8 ↗
2. Changchenkit, C. (2018). The Social Media Exposure and Online Clothes Buying Behavior in Thailand. Proceedings of the International Academic Conferences, International Institute of Social and Economic Sciences.10.20472/IAC.2018.036.005 ↗
3. Yang, F., Li, X., and Huang, Z. (2019). Buy-online-and-pick-up-in-store Strategy and Showroom Strategy in the Omnichannel Retailing. Advances in Business and Management Forecasting, Emerald Publishing Limited.10.1108/S1477-407020190000013007 ↗
4. Sun, L., Aragon-Camarasa, G., Rogers, S., Stolkin, R., and Siebert, J.P. (2017, January 24–28). Single-Shot Clothing Category Recognition in Free-Configurations with Application to Autonomous Clothes Sorting. Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2017), Vancouver, BC, Canada.10.1109/IROS.2017.8206586 ↗
5. Hu, J., and Kita, Y. (2015, January 3–5). Classification of the category of clothing item after bringing it into limited shapes. Proceedings of the 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), Seoul, Korea.10.1109/HUMANOIDS.2015.7363422 ↗
6. Chen, L., Han, R., Xing, S., and Ru, S. (2018, January 13–15). Research on Clothing Image Classification by Convolutional Neural Networks. Proceedings of the 2018 11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), Beijing, China.10.1109/CISP-BMEI.2018.8633249 ↗
7. Pan, H., Wang, Y., and Liu, Q. (2016, January 15–16). A Part-Based and Feature Fusion Method for Clothing Classification. Proceedings of the Pacific Rim Conference on Multimedia, Xi’an, China.
8. Multi-core SVM optimized visual word package model for garment style classification10.1007/s10586-018-2819-2 ↗
9. Geršak, J. (2013). 1–Clothing classification systems. Des. Cloth. Manuf. Process., 1–20.10.1533/9780857097835.1 ↗
10. Willimon, B., Birchfield, S., and Walker, I. (2011, January 9–13). Classification of clothing using interactive perception. Proceedings of the IEEE International Conference on Robotics & Automation, Shanghai, China.10.1109/ICRA.2011.5980336 ↗
11. Willimon, B., Walker, I., and Birchfield, S. (2013, January 6–10). A new approach to clothing classification using mid-level layers. Proceedings of the IEEE International Conference on Robotics & Automation, Karlsruhe, Germany.10.1109/ICRA.2013.6631181 ↗
12. Yamazaki, K., and Inaba, M. (2013, January 3–7). Clothing classification using image features derived from clothing fabrics, wrinkles and cloth overlaps. Proceedings of the 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.10.1109/IROS.2013.6696739 ↗
13. An, Y., and Rao-fen, W. (2019). Clothing Classification Method Based on CNN Improved Model Network. Tech. Autom. Appl.
14. Wang, W., Xu, Y., Shen, J., and Zhu, S.C. (2018, January 17). Attentive Fashion Grammar Network for Fashion Landmark Detection and Clothing Category Classification. Proceedings of the IEEE CVPR, San Francisco, CA, USA.10.1109/CVPR.2018.00449 ↗
15. A semisupervised recurrent convolutional attention model for human activity recognition10.1109/TNNLS.2019.2927224 ↗
16. An adaptive semisupervised feature analysis for video semantic recognition10.1109/TCYB.2017.2647904 ↗
17. Making sense of spatio-temporal preserving representations for EEG-based human intention recognition10.1109/TCYB.2019.2905157 ↗
18. Hong, Q., and Zhang, J. (2005). Introduction to Garment Style Classification. J. Chengdu Text. Coll.
19. Bossard, L., Dantone, M., Leistner, C., Wengert, C., and Gool, L.V. (2012). Apparel Classification with Style. Proceedings of the Asian Conference on Computer Vision-Volume Part IV, Springer.10.1007/978-3-642-37447-0_25 ↗
20. Liu, Z., Luo, P., Qiu, S., Wang, X., and Tang, X. (2016, January 27–30). DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.124 ↗
21. Kiapour, M.H., Han, X., Lazebnik, S., Berg, A.C., and Berg, T.L. (2015, January 13–16). Where to Buy It: Matching Street Clothing Photos in Online Shops. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.382 ↗
22. Qiang, C., Huang, J., Feris, R., Brown, L.M., and Yan, S. (2015, January 15). Deep Domain Adaptation for Describing People Based on Fine-Grained Clothing Attributes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, New York, NY, USA.
23. Li, G., and Feng, J. (2012). Unsupervised image clustering based on attribute method. Microcomput. Its Appl.
24. Vaccaro, K., Shivakumar, S., Ding, Z., Karahalios, K., and Kumar, R. (2016, January 16–19). The Elements of Fashion Style. Proceedings of the 29th Annual ACM Symposium on User Interface Software and Technology, Tokyo, Japan.10.1145/2984511.2984573 ↗
25. Seo, Y., and shik Shin, K. (2018, January 9–12). Image classification of fine-grained fashion image based on style using pre-trained convolutional neural network. Proceedings of the IEEE International Conference on Big Data Analysis, Shanghai, China.10.1109/ICBDA.2018.8367713 ↗
26. Fine-Grained Classification of Product Images Based on Convolutional Neural Networks10.4236/ami.2018.84007 ↗
27. Hidayati, S. (November, January 29). Clothing genre classification by exploiting the style elements. Proceedings of the ACM Multimedia Conference, Nara, Japan.
28. Di, W., Wah, C., Bhardwaj, A., Piramuthu, R., and Sundaresan, N. (2013, January 23–28). Style Finder: Fine-Grained Clothing Style Recognition and Retrieval. Proceedings of the IEEE Conference on Computer Vision & Pattern Recognition Workshops, Portland, OR, USA.10.1109/CVPRW.2013.6 ↗
29. ImageNet Classification with Deep Convolutional Neural Networks10.1145/3065386 ↗
30. Gradient-Based Learning Applied to Document Recognition10.1109/5.726791 ↗
31. Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. Comput. Sci.
32. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2014). Going Deeper with Convolutions. arXiv.10.1109/CVPR.2015.7298594 ↗
33. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 1). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), New York, NY, USA.10.1109/CVPR.2016.90 ↗
34. Attention is all you need
35. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10–17). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00986 ↗
36. A Survey on Transfer Learning
37. Liu, Z., Luo, P., Qiu, S., Wang, X., and Tang, X. (2016, June 18). Large-Scale Fashion (DeepFashion) Database. Available online: http://mmlab.ie.cuhk.edu.hk/projects/DeepFashion.html.
38. Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 7–14). Encoder-decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_49 ↗