MGN: multilayered garment animation generation neural network
Source abstract
Abstract
This paper presents a multilayered garment animation generation method. Generating realistic dynamics in 3D garment animations is a challenging task due to the complex nature of multilayered garments and the variety of outer forces involved. Existing data-driven approaches have mainly focused on the study of static draping deformation of multilayer garments, with less consideration for the temporal deformation of garments, such as the time-varying motion behaviors of individual layers and their continuous interactions during motion. In addition, these methods require a substantial amount of high-quality paired garment datasets for network training, leading to a costly data acquisition and annotation process. To address these challenges, we propose a multilayered garment animation generation method that explicitly models different garment layers as separate meshes, and employs a combination of unsupervised and temporally supervised learning strategies to analyze and model the behavior of individual garment layers and their interactions. Our primary contribution lies in introducing a two-stage network architecture for layered garment processing, which decomposes multilayer garment deformation prediction into single-layer garment generation and interlayer garment interaction deformation. We focus more on generating two-layered clothing animations. Of course, our two-layered approach can be used iteratively to support more layers by using the current outer layer as the inner layer for the next iteration. This approach achieves dynamic simulation of multilayer garments, and experimental results demonstrate that our method can generate realistic multilayer garment deformation effects, outperforming existing methods both visually and in terms of evaluation metrics.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: 3D Shape Modeling and Analysis · Computer Graphics and Visualization Techniques · Advanced Numerical Analysis Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Zhongguancun Science Academy, Beijing, China
Funding
National Natural Science Foundation of China · Science and Technology Program of Suzhou
References (37)
Show source-provided references
1. Provot X et al. Deformation constraints in a mass-spring model to describe rigid cloth behaviour. In: Graphics Interface. Canadian Information Processing Society 1995 pp. 147–147.
2. 10.1145/1882261.186618310.1145/1882261.1866183 ↗
3. Wu L, Wu B, Yang Y, et al. A safe and fast repulsion method for GPU-based cloth self collisions. ACM Trans Graph 2020; 40: 1–18.10.1145/3430025 ↗
4. Wang TY, Shao T, Fu K, et al. Learning an intrinsic garment space for interactive authoring of garment animation. ACM Trans Graph 2019; 38: 1–12. DOI: 10.1145/3355089.335651210.1145/3355089.3356512 ↗
5. Santesteban I Otaduy MA Casas D. Learning-based animation of clothing for virtual try-on. In: Computer Graphics Forum vol. 2. Wiley Online Library 2019 pp. 355–366.10.1111/cgf.13643 ↗
6. Patel C Liao Z Pons-Moll G. Tailornet: Predicting clothing in 3D as a function of human pose shape and garment style. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2020 pp. 7365–7375.10.1109/CVPR42600.2020.00739 ↗
7. Santesteban I, Otaduy M, Thuerey N, et al. ULNeF: untangled layered neural fields for mix-and-match virtual try-on. Adv Neur In 2022; 35: 12110–12125.
8. 10.52202/075280-175110.52202/075280-1751 ↗
9. Lee D, Kang H, Lee I-K. ClothCombo: Modeling inter-cloth interaction for draping multi-layered clothes. ACM Trans Graph 2023; 42: 1–13. DOI: 10.1145/361837610.1145/3618376 ↗
10. Shao Y Loy CC Dai B. Towards multi-layered 3D garments animation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision 2023 pp. 14361–14370.
11. 10.1145/3414685.341776310.1145/3414685.3417763 ↗
12. Müller M. Hierarchical position based dynamics.
13. 10.1145/276690710.1145/2766907 ↗
14. 10.1016/j.jvcir.2007.01.00510.1016/j.jvcir.2007.01.005 ↗
15. Vassilev T Spanlang B Chrysanthou Y. Fast cloth animation on walking avatars. In: Computer Graphics Forum vol. 3. Wiley Online Library 2001 pp. 260–267.10.1111/1467-8659.00518 ↗
16. Tang M Wang H Tang L et al. CAMA: Contact-aware matrix assembly with unified collision handling for GPU-based cloth simulation. In: Computer Graphics Forum vol. 2. Wiley Online Library 2016 pp. 511–521.10.1111/cgf.12851 ↗
17. Daviet G Bertails-Descoubes F Casati R. Fast cloth simulation with implicit contact and exact coulomb friction. In: Proceedings of the 14th ACM SIGGRAPH/Eurographics Symposium on Computer Animation 2015 pp. 197–197.10.1145/2786784.2795139 ↗
18. Wang TY Ceylan D Popovic J et al. Learning a shared shape space for multimodal garment design. arXiv preprint arXiv:180611335.
19. Gundogdu E Constantin V Seifoddini A et al. Garnet: A two-stream network for fast and accurate 3D cloth draping. In: Proceedings of the IEEE/CVF International Conference on Computer Vision 2019 pp. 8739–8748.10.1109/ICCV.2019.00883 ↗
20. Shen Y Liang J Lin MC. GAN-based garment generation using sewing pattern images. In: Computer Vision–ECCV 2020: 16th European Conference Glasgow UK 23–28 August 2020 proceedings part XVIII 16. Berlin: Springer 2020 pp. 225–247.10.1007/978-3-030-58523-5_14 ↗
21. Tiwari G Bhatnagar BL Tung T et al. Sizer: A dataset and model for parsing 3D clothing and learning size sensitive 3D clothing. In: Computer Vision–ECCV 2020: 16th European Conference Glasgow UK 23–28 August 2020 proceedings part III 16. Berlin: Springer 2020 pp. 1–18.10.1007/978-3-030-58580-8_1 ↗
22. Li D Y Tang M Yang Y et al. N-cloth: Predicting 3D cloth deformation with mesh-based networks. In: Computer Graphics Forum vol. 2. Wiley Online Library 2022 pp. 547–558.10.1111/cgf.14493 ↗
23. 10.1145/2601097.260113610.1145/2601097.2601136 ↗
24. Loper M Mahmood N Romero J et al. SMPL: A skinned multi-person linear model. In: Seminal Graphics Papers: Pushing the Boundaries vol. 2 2023 pp. 851–866.
25. Bertiche H Madadi M Escalera S. PBNS: Physically based neural simulator for unsupervised garment pose space deformation. arXiv preprint arXiv:201211310.
26. Santesteban I Otaduy MA Casas D. Snug: Self-supervised neural dynamic garments. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2022 pp. 8140–8150.10.1109/CVPR52688.2022.00797 ↗
27. 10.1016/j.displa.2023.10253410.1016/j.displa.2023.102534 ↗
28. 10.1145/3550454.355549110.1145/3550454.3555491 ↗
29. Grigorev A Black MJ Hilliges O. HOOD: Hierarchical graphs for generalized modelling of clothing dynamics. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2023 pp. 16965–16974.10.1109/CVPR52729.2023.01627 ↗
30. Luigi LD Li R Guillard B et al. DrapeNet: Garment generation and self-supervised draping. In: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2022 pp. 1451–1460.10.1109/CVPR52729.2023.00146 ↗
31. Tiwari L Bhowmick B Sinha S. GenSim: Unsupervised generic garment simulator. In: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) 2023 pp. 4169–4178.10.1109/CVPRW59228.2023.00439 ↗
32. Bhatnagar BL Tiwari G Theobalt C et al. Multi-garment net: Learning to dress 3d people from images. In: Proceedings of the IEEE/CVF International Conference on Computer Vision 2019 pp. 5420–5430.10.1109/ICCV.2019.00552 ↗
33. 10.1145/3550454.355546910.1145/3550454.3555469 ↗
34. Bertiche H Madadi M Tylson E et al. DeePSD: Automatic deep skinning and pose space deformation for 3D garment animation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision 2021 pp. 5471–5480.
35. Mahmood N Ghorbani N Troje NF et al. AMASS: Archive of motion capture as surface shapes. In: Proceedings of the IEEE/CVF International Conference on Computer Vision 2019 pp. 5442–5451.10.1109/ICCV.2019.00554 ↗
36. Vaswani A Shazeer N Parmar N et al. Attention is all you need. In Advances in Neural Information Processing Systems vol. 30.
37. Zhao F Li Z Huang S et al. Learning anchor transformations for 3D garment animation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2023 pp. 491–500.10.1109/CVPR52729.2023.00055 ↗