journal article·2023Open access

A Multi-Task Motion Generation Model that Fuses a Discriminator and a Generator

Xiuye Liu, Aihua Wu

Computers, Materials & Continua· Volume 76· Issue 1

Abstract

The human motion generation model can extract structural features from existing human motion capture data, and the generated data makes animated characters move. The 3D human motion capture sequences contain complex spatial-temporal structures, and the deep learning model can fully describe the potential semantic structure of human motion. To improve the authenticity of the generated human motion sequences, we propose a multi-task motion generation model that consists of a discriminator and a generator. The discriminator classifies motion sequences into different styles according to their similarity to the mean spatial-temporal templates from motion sequences of 17 crucial human joints in three-freedom degrees. And target motion sequences are created with these styles by the generator. Unlike traditional related works, our model can handle multiple tasks, such as identifying styles and generating data. In addition, by extracting 17 crucial joints from 29 human joints, our model avoids data redundancy and improves the accuracy of model recognition. The experimental results show that the discriminator of the model can effectively recognize diversified movements, and the generated data can correctly fit the actual data. The combination of discriminator and generator solves the problem of low reuse rate of motion data, and the generated motion sequences are more suitable for actual movement.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Human Motion and Animation · Human Pose and Action Recognition · Robot Manipulation and Learning

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (25)

Show source-provided references
1. Generative adversarial networks10.1145/3422622 ↗
2. Kadu · Human Gesture and Behavior Understanding, Joint ACM Workshop · 2011 · 73
3. Action recognition on motion capture data using a dynemes and forward differences representation10.1016/j.jvcir.2014.04.007 ↗
4. Real-time classification of dance gestures from skeleton animation
5. Toward accurate dynamic time warping in linear time and space10.3233/IDA-2007-11508 ↗
6. Modeling human motion using binary latent variables
7. Dynamical binary latent variable models for 3D human pose tracking
8. A style controller for generating virtual human behaviors
9. Deep temporal sigmoid belief networks for sequence modeling
10. Restricted Boltzmann machines for collaborative filtering
11. Recurrent semi-supervised classification and constrained adversarial generation with motion capture data10.1016/j.imavis.2018.07.001 ↗
12. J. Bayer and C. Osendorfer, “Learning stochastic recurrent networks,” arXiv: 1411.7610, 2014.
13. Y. Park, S. Moon and I. H. Suh, “Tracking human-like natural motion using deep recurrent neural networks,” arXiv: 1604.04528, 2016.
14. A stochastic variational framework for recurrent gaussian processes models
15. On human motion prediction using recurrent neural networks
16. A learning algorithm for continually running fully recurrent neural networks10.1162/neco.1989.1.2.270 ↗
17. J. Chung, C. Gulcehre, K. H. Cho and Y. Bengio, “Empirical evaluation of gated recurrent neural networks on sequence modeling,” arXiv: 1412.3555, 2014.
18. D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv: 1412.6980, 2014.
19. Deep learning
20. Factored conditional restricted Boltzmann machines for modeling motion style
21. Recurrent network models for human dynamics
22. Structural-RNN: Deep learning on spatio-temporal graphs
23. Factored temporal sigmoid belief networks for sequence learning
24. T. Yongyi, M. Lin, L. Wei and Z. Weishi, “Long-term human motion prediction by modeling motion context and enhancing motion dynamic,” arXiv: 1805.02513, 2018.
25. Convolutional sequence to sequence model for human dynamics