L-DGC: LLM-Based Dance Generative Control
Source abstract
Abstract
The global expansion of K-pop has increased demand for AI-driven choreography learning. However, existing motion recognition models often struggle to capture fine-grained rhythm patterns and dynamic motion transitions across consecutive frames, limiting their ability to provide accurate and objective feedback. To address these challenges, this paper proposes a Large Language Model-based Dance Generative Control (L-DGC), an integrated framework for controllable dance generation and evaluation. The framework comprises four stages: a Visual Analysis Phase (VAP) for skeletal extraction; an Audio Analysis Phase (AAP) for rhythmic synchronization; a Multimodal Data Phase (MDP), which employs Long Short-Term Memory (LSTM) and Transformer architectures to evaluate movement accuracy; and a three-dimensional (3D) Transformation Phase (3TP), which converts two-dimensional (2D) skeletal data into 3D character animations within the Unity engine. Guided by an LLM, the framework performs real-time inference and iterative refinement to optimize choreographic data without requiring subjective expert assessment. By quantifying choreographic components and transforming 2D motion data into 3D representations, L-DGC provides an objective evaluation framework for dance learning. The proposed system has significant potential for artificial intelligence (AI)-based dance education, real-time feedback applications, and automated audition platforms in the entertainment industry.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Human Motion and Animation · Diversity and Impact of Dance · Music Technology and Sound Studies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Engineering, Graduate School, Dongguk University-Seoul, Seoul 04620, Republic of Korea
Division of Computer Science and Artificial Intelligence, Dongguk University-Seoul, Seoul 04620, Republic of Korea
Funding
Seoul RISE Center
References (18)
Show source-provided references
1. Yi, H., Li, H., Liu, J., Zhou, X., Ye, J., and Wang, Z. (2023). E-Dance: Large Language Model-Guided Dance Generation. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), IEEE.
2. Mathematical discoveries from program search with large language models10.1038/s41586-023-06924-6 ↗
3. MotivDance: Fine-Grained Text-Guided Motivation Choreography with Music Synchronization
4. TCDiff++: An End-to-end Trajectory-Controllable Diffusion Model for Harmonious Music-Driven Group Choreography
5. GCDance: Genre-Controlled Music-Driven 3D Full Body Dance Generation
6. Zhang, X., Li, Y., and Chen, S. (2025). DanceChat: Large Language Model-Guided Music-to-Dance Generation. arXiv.
7. MotionGPT: Human motion as a foreign language
8. Chen, H., Huang, Z., Dai, P., Zhang, H., and Lin, G. (2022). Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memory. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.
9. Athanasiou, N., Petrovich, M., Black, M.J., and Varol, G. (2022). TEACH: Temporal Action Composition for 3D Humans. Proceedings of the International Conference on 3D Vision (3DV), IEEE.10.1109/3DV57658.2022.00053 ↗
10. Tevet, G., Raab, S., Gordon, B., Shafir, Y., Cohen-Or, D., and Bermano, A.H. (2023, January 1–5). Human Motion Diffusion Model. Proceedings of the International Conference on Learning Representations (ICLR), Kigali, Rwanda.
11. Zhang, M., Guo, X., Pan, L., Cai, Z., and Hong, F. (2023). ReMoDiffuse: Retrieval-augmented motion diffusion model. Proceedings of the IEEE/CVF International Conference on Computer Vision, IEEE.10.1109/ICCV51070.2023.00040 ↗
12. Gong, K., Lian, D., Chang, H., Guo, C., Jiang, Z., Zuo, X., and Wang, X. (2023). TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integration. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), IEEE.10.1109/ICCV51070.2023.00912 ↗
13. DanceFormer: Music Conditioned 3D Dance Generation with Parametric Motion Transformer
14. Petrovich, M., Black, M.J., and Varol, G. (2021). Action-Conditioned 3D Human Motion Synthesis with Transformer VAE. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), IEEE.10.1109/ICCV48922.2021.01080 ↗
15. Guo, C., Zou, S., Zuo, X., Wang, S., Ji, W., Li, X., and Cheng, L. (2022). Generating Diverse and Natural 3D Human Motions from Text. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.10.1109/CVPR52688.2022.00509 ↗
16. ChoreoMaster: Choreography-oriented music-driven dance synthesis10.1145/3450626.3459932 ↗
17. Petrovich, M., Black, M.J., and Varol, G. (2022). TEMOS: Generating diverse human motions from textual descriptions. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.10.1007/978-3-031-20047-2_28 ↗
18. Tseng, H.Y., Castellano, G., and Tulyakov, S. (2023). EDGE: Editable Dance Generation from Music. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.10.1109/CVPR52729.2023.00051 ↗