journal article·2025Open access

Evaluating Method of Lower Limb Coordination Based on Spatial-Temporal Dependency Networks

Xuelin Qin, Huinan Sang, Shihua Wu, Shishu Chen, Zhiwei Chen, Yongjun Ren

Computers, Materials & Continua· Volume 85· Issue 1

Abstract

As an essential tool for quantitative analysis of lower limb coordination, optical motion capture systems with marker-based encoding still suffer from inefficiency, high costs, spatial constraints, and the requirement for multiple markers. While 3D pose estimation algorithms combined with ordinary cameras offer an alternative, their accuracy often deteriorates under significant body occlusion. To address the challenge of insufficient 3D pose estimation precision in occluded scenarios—which hinders the quantitative analysis of athletes’ lower-limb coordination—this paper proposes a multimodal training framework integrating spatiotemporal dependency networks with text-semantic guidance. Compared to traditional optical motion capture systems, this work achieves low-cost, high-precision motion parameter acquisition through the following innovations: (1) spatiotemporal dependency attention module is designed to establish dynamic spatiotemporal correlation graphs via cross-frame joint semantic matching, effectively resolving the feature fragmentation issue in existing methods. (2) noise-suppressed multi-scale temporal module is proposed, leveraging KL divergence-based information gain analysis for progressive feature filtering in long-range dependencies, reducing errors by 1.91 mm compared to conventional temporal convolutions. (3) text-pose contrastive learning paradigm is introduced for the first time, where BERT-generated action descriptions align semantic-geometric features via the BERT encoder, significantly enhancing robustness under severe occlusion (50% joint invisibility). On the Human3.6M dataset, the proposed method achieves an MPJPE of 56.21 mm under Protocol 1, outperforming the state-of-the-art baseline MHFormer by 3.3%. Extensive ablation studies on Human3.6M demonstrate the individual contributions of the core modules: the spatiotemporal dependency module and noise-suppressed multi-scale temporal module reduce MPJPE by 0.30 and 0.34 mm, respectively, while the multimodal training strategy further decreases MPJPE by 0.6 mm through text-skeleton contrastive learning. Comparative experiments involving 16 athletes show that the sagittal plane coupling angle measurements of hip-ankle joints differ by less than 1.2° from those obtained via traditional optical systems (two one-sided t-tests, p < 0.05), validating real-world reliability. This study provides an AI-powered analytical solution for competitive sports training, serving as a viable alternative to specialized equipment.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Winter Sports Injuries and Performance · Advanced Computing and Algorithms

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (34)

Show source-provided references
1. Study on the influence of proprioceptive control versus visual control on reaction speed, hand coordination, and lower limb balance in young students 14–15 years old10.3390/ijerph181910356 ↗
2. Poor motor coordination elicits altered lower limb biomechanics in young football (soccer) players: implications for injury prevention through wearable sensors10.3390/s21134371 ↗
3. Is impaired coordination related to match physical load in footballers with cerebral palsy of different sport classes?10.1080/02640414.2021.1880740 ↗
4. A new approach for quantitative analysis of inter-joint coordination during gait10.1109/TBME.2007.901034 ↗
5. On the use of continuous relative phase: review of current approaches and outline for a new standard10.1016/j.clinbiomech.2014.03.008 ↗
6. Winter · Biomechanics and motor control of human movement · 200910.1002/9780470549148 ↗
7. Relationships between task constraints, visual constraints, joint coordination and football-specific performance in talented youth athletes: an ecological dynamics approach10.1177/00315125231213124 ↗
8. Quantifying rearfoot-forefoot coordination in human walking10.1016/j.jbiomech.2008.07.024 ↗
9. Learning skeletal graph neural networks for hard 3D pose estimation
10. Multistream adaptive attention-enhanced graph convolutional networks for youth fencing footwork training10.1123/pes.2024-0025 ↗
11. Influence of medial longitudinal arch flexibility on lower limb joint coupling coordination and gait impulse10.1016/j.gaitpost.2024.10.002 ↗
12. A new coordination pattern classification to assess gait kinematics when utilizing a modified vector coding technique10.1016/j.jbiomech.2015.07.023 ↗
13. Hip-ankle coordination during gait in individuals with chronic ankle instability10.1016/j.gaitpost.2017.02.001 ↗
14. Deyzel M. Markerless versus marker-based 3D human pose estimation for strength and conditioning exercise identification [Ph.D. dissertation]. Stellenbosch, South Africa: Stellenbosch University; 2023.
15. DGCN: dynamic graph convolutional network for efficient multi-person pose estimation
16. Exploiting spatial-temporal relationships for 3D pose estimation via graph convolutional networks
17. Graph and temporal convolutional networks for 3D multi-person pose estimation in monocular videos
18. ARHPE: asymmetric relation-aware representation learning for head pose estimation in industrial human-computer interaction10.1109/TII.2022.3143605 ↗
19. LDCNet: limb direction cues-aware network for flexible human pose estimation in industrial behavioral biometrics systems10.1109/TII.2023.3266366 ↗
20. EHPE: skeleton cues-based gaussian coordinate encoding for efficient human pose estimation10.1109/TMM.2022.3197364 ↗
21. Neuro-modulation analysis based on muscle synergy graph neural network in human locomotion10.1109/TNSRE.2025.3557777 ↗
22. 3D human pose estimation with spatial and temporal transformers
23. P-STMO: pre-trained spatial temporal many-to-one model for 3D human pose estimation
24. Temporal convolutional networks for action segmentation and detection
25. A study on the lower limb movement coordination characteristics of female speed skaters based on inertial measurement units
26. Research status of data application based on optical motion capture technology
27. Adaptive occlusion state estimation for human pose tracking under self-occlusions10.1016/j.patcog.2012.09.006 ↗
28. Path signature-based xai-enabled network time series classification10.1007/s11432-023-3978-y ↗
29. Leveraging spatio-temporal dependency for skeleton-based action recognition
30. Generative action description prompts for skeleton-based action recognition
31. Human3.6M: large scale datasets and predictive methods for 3D human sensing in natural environments10.1109/TPAMI.2013.248 ↗
32. Cascaded pyramid network for multi-person pose estimation
33. Learning to fuse 2D and 3D image cues for monocular body pose estimation
34. 3D human pose estimation in video with temporal convolutions and semi-supervised training