KnitDiff: Constraint-aware diffusion modeling for knit pattern generation
Source abstract
Abstract
This study introduces KnitDiff, a constraint-aware diffusion modeling framework for intelligent knit pattern generation. Integrating a KnitPrompt Engine with Stable Diffusion models, KnitDiff bridges creative design and textile engineering by translating user-friendly language into technically compliant prompts. The system incorporates three key innovations: (1) a knit vocabulary constructor that maps natural language inputs to structured textile parameters; (2) a dynamic learning system that adapts to user preferences and evolving fashion trends; and (3) a multidimensional evaluation module that quantifies texture, structural integrity, and aesthetic coherence. Reinforcement learning and quality-aware feedback loops guide iterative optimization, while a comprehensive prompt library facilitates both design diversity and manufacturability. Empirical evaluations show KnitDiff significantly improves generation quality, user satisfaction, and alignment with production standards compared with baseline models. The framework offers a scalable solution for democratizing textile design through human–AI collaboration.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: 3D Shape Modeling and Analysis · Fashion and Cultural Textiles · Textile materials and evaluations
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Division of Integrative Systems and Design, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
Funding
Hong Kong General Research Fund
References (36)
Show source-provided references
1. 10.1613/jair.390810.1613/jair.3908 ↗
2. McCorduck P. Aaron’s Code: Meta-Art, Artificial Intelligence, and the Work of Harold Cohen. New York: W.H. Freeman, 1991.
3. Nicholson CV. Artificial intelligence (AI) vs. machine learning vs. deep learning. Pathmind http://wiki.pathmind.com/ai-vs-machine-learning-vs-deep-learning (accessed 2 April 2020).
4. 10.1145/318669710.1145/3186697 ↗
5. 10.1038/nature1453910.1038/nature14539 ↗
6. 10.48550/arXiv.1312.619910.48550/arXiv.1312.6199 ↗
7. McKinsey & Company. What is Generative Ai? https://www.mckinsey.com/featured-insights/mckinsey-explainers/what-is-generative-ai (2024).
8. Wu J. Introduction to Convolutional Neural Networks. Nanjing: Nanjing University, 2017, p. 23.
9. Goodfellow I, Pouget-Abadie J, Mirza M, et al. Generative adversarial networks. CACM 2014; 63: 139–144.
10. Horner A, Goldberg DE. Genetic algorithms and computer-assisted music composition. ICMC 1991; 51: 479-482.
11. 10.1038/nature1454110.1038/nature14541 ↗
12. Victoria and Albert Museum. A History of Computer Art http://www.vam.ac.uk/content/articles/a/computer-art-history/ (2016 accessed 1 April 2020).
13. 10.1007/978-3-642-31727-910.1007/978-3-642-31727-9 ↗
14. 10.1023/A:101361451917910.1023/A:1013614519179 ↗
15. Kim HS, Cho SB. Application of interactive genetic algorithm to fashion design. EAAI 2000; 13(6): 635-644.
16. 10.1016/j.cad.2013.06.01410.1016/j.cad.2013.06.014 ↗
17. 10.1007/978-3-319-55750-2_2010.1007/978-3-319-55750-2_20 ↗
18. 10.1108/IJCST-03-2015-004210.1108/IJCST-03-2015-0042 ↗
19. 10.1186/s40691-023-00360-w10.1186/s40691-023-00360-w ↗
20. 10.1111/cgf.1355210.1111/cgf.13552 ↗
21. 10.48550/arXiv.1804.0092110.48550/arXiv.1804.00921 ↗
22. 10.1080/09540091.2020.182278010.1080/09540091.2020.1822780 ↗
23. 10.14733/cadaps.2021.900-91310.14733/cadaps.2021.900-913 ↗
24. Yuan C, Moghaddam M. Attribute-aware generative design with generative adversarial networks. IEEE Access 2020; 8: 190710-190721.
25. 10.1108/IJCST-02-2014-002210.1108/IJCST-02-2014-0022 ↗
26. 10.1007/978-3-319-42007-3_4810.1007/978-3-319-42007-3_48 ↗
27. 10.1109/TMM.2017.269014410.1109/TMM.2017.2690144 ↗
28. Hsiao W, Katsman I, Wu C, et al. FashionÞÞ: Minimal edits for outfit improvement. In: Proceedings of ICCV, 2019.
29. 10.1016/j.neucom.2019.03.01110.1016/j.neucom.2019.03.011 ↗
30. Wu X, Li L. An application of generative AI for knitted textile design in fashion. TDJ 2024; 27(2): 270-290.
31. Wang R et al StableGarment: Garment-centric generation via stable diffusion. arXiv preprint arXiv:2403.10783 (2024).
32. 10.1109/ICECET61485.2024.1069839810.1109/ICECET61485.2024.10698398 ↗
33. Karagöz HF et al. Textile pattern generation using diffusion models. arXiv preprint arXiv:2304.00520 (2023).
34. Liu S Cheng Y Chen Z et al. Multimodal latent diffusion model for complex sewing pattern generation. arXiv preprint arXiv:2412.14453 2024.
35. 10.3390/app1516899910.3390/app15168999 ↗
36. 10.1109/ICSADL65848.2025.1093346510.1109/ICSADL65848.2025.10933465 ↗