journal article·2025Open access

VMHPE: Human Pose Estimation for Virtual Maintenance Tasks

Shuo Zhang, Hanwu He, Yueming Wu

Computers, Materials & Continua· Volume 85· Issue 1

Abstract

Virtual maintenance, as an important means of industrial training and education, places strict requirements on the accuracy of participant pose perception and assessment of motion standardization. However, existing research mainly focuses on human pose estimation in general scenarios, lacking specialized solutions for maintenance scenarios. This paper proposes a virtual maintenance human pose estimation method based on multi-scale feature enhancement (VMHPE), which integrates adaptive input feature enhancement, multi-scale feature correction for improved expression of fine movements and complex poses, and multi-scale feature fusion to enhance keypoint localization accuracy. Meanwhile, this study constructs the first virtual maintenance-specific human keypoint dataset (VMHKP), which records standard action sequences of professional maintenance personnel in five typical maintenance tasks and provides a reliable benchmark for evaluating operator motion standardization. The dataset is publicly available at . Using high-precision keypoint prediction results, an action assessment system utilizing topological structure similarity was established. Experiments show that our method achieves significant performance improvements: average precision (AP) reaches 94.4%, an increase of 2.3 percentage points over baseline methods; average recall (AR) reaches 95.6%, an increase of 1.3 percentage points. This research establishes a scientific four-level evaluation standard based on comparative motion analysis and provides a reliable solution for standardizing industrial maintenance training.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Human Pose and Action Recognition · Hand Gesture Recognition Systems · Gait Recognition and Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (34)

Show source-provided references
1. A VR-based complex equipment maintenance training system
2. A comprehensive survey on human pose estimation approaches10.1007/s00530-022-00980-0 ↗
3. An enhanced real-time human pose estimation method based on modified YOLOv8 framework10.1038/s41598-024-58146-z ↗
4. A distributed virtual reality system based on real-time dynamic calculation and multi-person collaborative operation applied to the development of subsea production systems10.5750/ijme.v163iA3.798 ↗
5. Virtual reality based digital chain for maintenance training10.1016/j.procir.2019.04.268 ↗
6. Using virtual reality to support the productś maintainability design: immersive maintainability verification and evaluation system10.1016/j.compind.2018.06.007 ↗
7. Fusing wearable IMUs with multi-view images for human pose estimation: a geometric approach
8. Augmented reality in support of Industry 4.0—Implementation challenges and success factors10.1016/j.rcim.2019.02.003 ↗
9. Augmented reality via expert demonstration authoring (AREDA)10.1016/j.compind.2018.04.021 ↗
10. OpenPose: realtime multi-person 2D pose estimation using part affinity fields10.1109/TPAMI.2019.2929257 ↗
11. Deep high-resolution representation learning for human pose estimation
12. Coherent reconstruction of multiple humans from a single image
13. Lin · Computer Vision—ECCV 2014 · 2014 · 74010.1007/978-3-319-10602-1_48 ↗
14. Jin · Computer Vision—ECCV 2020 · 2020 · 19610.1007/978-3-030-58545-7_12 ↗
15. RMPE: regional multi-person pose estimation
16. CrowdPose: efficient crowded scenes pose estimation and a new benchmark
17. Güler RA, Neverova N, Kokkinos I. DensePose: dense human pose estimation in the wild. arXiv:1802.00434. 2018.10.1109/CVPR.2018.00762 ↗
18. A Benchmark dataset and evaluation methodology for video object segmentation
19. Scaling egocentric vision: the EPIC-KITCHENS dataset
20. Human pose estimation via deep neural networks
21. Scale-aware representation learning for bottom-up human pose estimation
22. AlphaPose: whole-body regional multi-person pose estimation and tracking in real-time10.1109/TPAMI.2022.3222784 ↗
23. Xu · Advances in neural information processing systems · 2022 · 35 · 38571
24. FCPose: fully convolutional multi-person pose estimation with dynamic instance-aware convolutions
25. SimCC: a simple coordinate classification perspective for human pose estimation
26. Zeng · Computer Vision—ECCV 2022 · 2022 · 62510.1007/978-3-031-20065-6_36 ↗
27. Zhang F, Bazarevsky V, Vakunov A, Tkachenka A, Sung G, Chang C, et al. MediaPipe hands: on-device real-time hand tracking. arXiv:2006.10214. 2020.
28. Moon · Computer Vision—ECCV 2020 · 2020 · 54810.1007/978-3-030-58565-5_33 ↗
29. RTMO: towards high-performance one-stage real-time multi-person pose estimation
30. A virtual-reality spatial matching algorithm and its application on equipment maintenance support: system design and user study10.1016/j.image.2024.117188 ↗
31. Virtual gym tracker: AI pose estimation
32. Urgo · CIRP novel topics in production engineering · 2024 · 1 · 310.1007/978-3-031-54034-9_1 ↗
33. Contextual instance decoupling for robust multi-person pose estimation
34. FLK: a filter with learned kinematics for real-time 3D human pose estimation10.1016/j.sigpro.2024.109598 ↗