Product Innovation Design Based on Deep Learning and Kansei Engineering
Source abstract
Abstract
Creative product design is becoming critical to the success of many enterprises. However, the conventional product innovation process is hindered by two major challenges: the difficulty to capture users’ preferences and the lack of intuitive approaches to visually inspire the designer, which is especially true in fashion design and form design of many other types of products. In this paper, we propose to combine Kansei engineering and the deep learning for product innovation (KENPI) framework, which can transfer color, pattern, etc. of a style image in real time to a product’s shape automatically. To capture user preferences, we combine Kansei engineering with back-propagation neural networks to establish a mapping model between product properties and styles. To address the inspiration issue in product innovation, the convolutional neural network-based neural style transfer is adopted to reconstruct and merge color and pattern features of the style image, which are then migrated to the target product. The generated new product image can not only preserve the shape of the target product but also have the features of the style image. The Kansei analysis shows that the semantics of the new product have been enhanced on the basis of the target product, which means that the new product design can better meet the needs of users. Finally, implementation of this proposed method is demonstrated in detail through a case study of female coat design.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Color perception and design · Color Science and Applications · Digital Media and Visual Art
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mechanical Engineering, Guizhou University, Guiyang 550025, China
Department of Computer Science and Engineering, University of South Carolina, Columbia, SC 29208, USA
Funding
National Natural Science Foundation of China · Science and Technology Foundation of Guizhou Province
References (33)
Show source-provided references
1. DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs10.1109/TPAMI.2017.2699184 ↗
2. Ren, S., He, K., Girshick, R., and Sun, J. (2017). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks, MIT Press.10.1109/TPAMI.2016.2577031 ↗
3. ImageNet Classification with Deep Convolutional Neural Networks10.1145/3065386 ↗
4. Deep Learning for Automatic Usability Evaluations Based on Images: A Case Study of the Usability Heuristics of Thermostats10.1016/j.enbuild.2017.12.043 ↗
5. Pan, Y., Burnap, A., Hartley, J., Gonzalez, R., and Papalambros, P.Y. (2017, January 13–17). Deep Design: Product Aesthetics for Heterogeneous Markets. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada.10.1145/3097983.3098176 ↗
6. Mapping Customer Needs to Design Parameters in the Front End of Product Design by Applying Deep Learning10.1016/j.cirp.2018.04.018 ↗
7. Generative Visual Manipulation on the Natural Image Manifold
8. Isola, P., Zhu, J.Y., Zhou, T., and Alexei, A.E. (2017, January 21–26). Image-to-Image Translation with Conditional Adversarial Networks. Proceedings of the Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.632 ↗
9. Chai, C.L., Liao, J., Zou, N., and Sun, L.Y. (2018). A One-to-many Conditional Generative Adversarial Network Framework for Multiple Image-to-image Translations. Multimed. Tools Appl., 1–28.10.1007/s11042-018-5968-7 ↗
10. Kim, T., Cha, M., Kim, H., Lee, J.K., and Kim, J. (2018, May 06). Learning to Discover Cross-Domain Relations with Generative Adversarial Networks. Available online: https://arxiv.org/abs/1703.05192v1.
11. Kansei engineering as a powerful consumer-oriented technology for product development10.1016/S0003-6870(02)00019-4 ↗
12. Liu, C.Y., and Tong, L.I. (2018). Developing Automatic Form and Design System Using Integrated Grey Relational Analysis and Affective Engineering. Appl. Sci., 8.10.3390/app8010091 ↗
13. Consumers’ perception-oriented product form design using multiple regression analysis and backpropagation neural network
14. Application of neural network in QFD matrix10.1007/s10845-011-0604-7 ↗
15. A Kansei evaluation approach based on the technique of computing with words10.1016/j.aei.2015.11.001 ↗
16. Developing a design support system for the exterior form of running shoes10.1016/j.cie.2013.05.008 ↗
17. Kansei engineering as a tool for the design of in-vehicle rubber keypads10.1016/j.apergo.2016.12.019 ↗
18. Kansei assessment of the constituent elements and the overall interrelations in car steering wheel design10.1016/j.ergon.2016.09.010 ↗
19. A Neural Algorithm of Artistic Style10.1167/16.12.326 ↗
20. Gatys, L.A., Ecker, A.S., and Bethge, M. (2016, January 27–30). Image Style Transfer Using Convolutional Neural Networks. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.265 ↗
21. Gatys, L.A., Ecker, A.S., and Bethge, M. (2016, January 27–30). Texture Synthesis Using Convolutional Neural Networks. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.265 ↗
22. Ulyanov, D., Lebedev, V., Vedaldi, A., and Lempitsky, V. (2017). Texture Networks: Feed-forward Synthesis of Textures and Stylized Images. Comput. Vis. Pattern Recogn.
23. Huang, X., and Belongie, S. (arXiv, 2017). Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization, arXiv.10.1109/ICCV.2017.167 ↗
24. Development of a Computer Aided Product-form Design Tool Based on Numerical Definition Scheme and Neural Network10.1299/jamdsm.2014jamdsm0033 ↗
25. An Optimal Artificial Neural Network System for Designing Knit Stretch Fabrics10.1080/00405000.2012.756134 ↗
26. Concepts, methods and tools in Kansei engineering10.1080/1463922021000049980 ↗
27. Product Form Design Using Customer Perception Evaluation by a Combined Superellipse Fitting and ANN Approach10.1016/j.aei.2013.03.006 ↗
28. Comparison of Multi-objective Evolutionary Algorithms in Hybrid Kansei Engineering system for product form design10.1016/j.aei.2018.02.002 ↗
29. A design decision-making support model for customized product color combination10.1016/j.compind.2006.11.001 ↗
30. Lin, T., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., and Ar, P.D. (2014). Microsoft COCO: Common Objects in Context. Lecture Notes Comput. Sci., 740–755.10.1007/978-3-319-10602-1_48 ↗
31. Chen, T.Q., and Schmidt, M. (arXiv, 2016). Fast Patch-based Style Transfer of Arbitrary Style, arXiv.
32. Kingma, D.P., and Ba, J.L. (arXiv, 2015). Adam: A method for stochastic optimization, arXiv.
33. Fitting the semantic differential to the marketing problem10.1177/002224296102500406 ↗