journal article·2025-09-29Open access

Estimation of Forearm Pronation–Supination Angles Using MediaPipe and IMU Sensors: Performance Comparison and Interpretability Analysis of Machine Learning Models

Masaya Kusunose, Atsuyuki Inui, Yutaka Mifune, Kohei Yamaura, Issei Shinohara, Shuya Tanaka, Yutaka Ehara, Shunsaku Takigami, Shin Osawa, Daiji Nakabayashi, Takanobu Higashi, Ryota Wakamatsu, Shinya Hayashi, Tomoyuki Matsumoto, Ryosuke Kuroda

Applied Sciences· Volume 15· Issue 19

Abstract

This study aimed to develop a non-contact, marker-less machine learning model to estimate forearm pronation–supination angles using 2D hand landmarks derived from MediaPipe Hands, with inertial measurement unit sensor angles used as reference values. Twenty healthy adults were recorded under two camera conditions: medial (in-camera) and lateral (out-camera) viewpoints. Five regression models were trained and evaluated: Linear Regression, ElasticNet, Support Vector machine (SVM), Random Forest, and Light Gradient Boosting Machine (LightGBM). Among them, LightGBM achieved the highest accuracy, with a mean absolute error of 5.61° in the in-camera setting and 4.65° in the out-camera setting. The corresponding R2 values were 0.973 and 0.976, respectively. The SHAP analysis identified geometric variations in the palmar triangle as the primary contributors, whereas elbow joint landmarks had a limited effect on model predictions. These results suggest that forearm rotational angles can be reliably estimated from 2D images, with an accuracy comparable to that of conventional goniometers. This technique offers a promising alternative for functional evaluation in clinical settings without requiring physical contact or markers and may facilitate real-time assessment in remote rehabilitation or outpatient care.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Shoulder Injury and Treatment · Orthopedic Surgery and Rehabilitation · Sports Performance and Training

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Orthopaedic Surgery, Kobe University Graduate School of Medicine, Kobe 650-0017, Japan

Funding

JSPS KAKENHI

References (35)

Show source-provided references
1. The forearm complex: Anatomy, biomechanics and clinical considerations10.1197/j.jht.2006.02.002 ↗
2. Skirven, T.M., Osterman, A.L., Fedorczyk, J.M., and Amadio, P.C. (2011). Anatomy and kinesiology of the elbow. Rehabilitation of the Hand and Upper Extremity, Elsevier. [6th ed.]. Chapter 3.
3. Functional outcomes and complications after treatment of distal radius fracture in patients sixty years and over: A systematic review and network meta-analysis10.1016/j.injury.2023.04.054 ↗
4. Pronation and supination of the hand: Anatomy and biomechanics10.1016/j.hansur.2016.09.012 ↗
5. Biomechanics of pronation and supination of the forearm10.1016/S0749-0712(21)00605-3 ↗
6. Changes in contact site of the radiocarpal joint and lengths of the carpal ligaments in forearm rotation: An in vivo study10.1016/j.jhsa.2013.01.021 ↗
7. Biomechanics of the Distal Radioulnar Joint During In Vivo Forearm Pronosupination10.1055/s-0040-1722334 ↗
8. The role of radial head morphology in proximal radioulnar joint congruency during forearm rotation10.1002/jeo2.70059 ↗
9. Gilula, L. (1996). Physical examination and provocative maneuvers of the wrist. Imaging of the Hand, Saunders.
10. Accuracy and validity of observational estimates of wrist and forearm posture10.1080/00140130310001653057 ↗
11. An investigation into the degree of precision achieved by a team of hand therapists and surgeons using hand goniometry with a standardised protocol10.1177/175899830400900401 ↗
12. Pronation and supination after forearm fractures in children: Reliability of visual estimation and conventional goniometry measurement10.1016/j.injury.2010.02.007 ↗
13. Reliability of range-of-motion measurement in the elbow and forearm10.1016/S1058-2746(98)90003-9 ↗
14. The inter-rater reliability of the modified finger goniometer for measuring forearm rotation10.1016/j.jht.2016.02.010 ↗
15. A simplified quaternion-based algorithm for orientation estimation from earth gravity and magnetic field measurements10.1109/TIM.2007.911646 ↗
16. A functional calibration procedure for 3D knee joint angle description using inertial sensors10.1016/j.jbiomech.2009.06.025 ↗
17. The reliability of the three-dimensional fastrak measurement system in measuring cervical spine and shoulder range of motion in healthy subjects10.1093/rheumatology/39.4.382 ↗
18. Hsu, Y.L., Wang, J.S., Lin, Y.C., Chen, S.M., Tsai, Y.J., Chu, C.L., and Chang, C.-W. (2013, January 12–16). A wearable inertial-sensing-based body sensor network for shoulder range of motion assessment. Proceedings of the International Conference on Orange Technologies (ICOT), Tainan, Taiwan.10.1109/ICOT.2013.6521225 ↗
19. Ambulatory measurement of the scapulohumeral rhythm: Intra- and inter-operator agreement of a protocol based on inertial and magnetic sensors10.1016/j.gaitpost.2011.12.015 ↗
20. Tan, T., Chiasson, D.P., Hu, H., and Shull, P.B. (2019). Influence of IMU position and orientation placement errors on ground reaction force estimation. J. Biomech., 97.10.1016/j.jbiomech.2019.109416 ↗
21. IMU-based sensor-to-segment multiple calibration for upper limb joint angle measurement—A proof of concept10.1007/s11517-019-02033-7 ↗
22. Pérez-Chirinos Buxadé, C., Fernández-Valdés, B., Morral-Yepes, M., Tuyà Viñas, S., Padullés Riu, J.M., and Moras Feliu, G. (2021). Validity of a Magnet-Based Timing System Using the Magnetometer Built into an IMU. Sensors, 21.10.3390/s21175773 ↗
23. Lafayette, T.B.G., Kunst, V.H.L., Melo, P.V.S., Guedes, P.O., Teixeira, J., Vasconcelos, C.R., Teichrieb, V., and da Gama, A.E.F. (2022). Validation of Angle Estimation Based on Body Tracking Data from RGB-D and RGB Cameras for Biomechanical Assessment. Sensors, 23.10.3390/s23010003 ↗
24. Hand tracking for clinical applications: Validation of the Google MediaPipe Hand (GMH) and the depth-enhanced GMH-D frameworks
25. Quantifying similarities between MediaPipe and a known standard to address issues in tracking 2D upper limb trajectories: Proof of concept study10.2196/56682 ↗
26. Kusunose, M., Inui, A., Nishimoto, H., Mifune, Y., Yoshikawa, T., Shinohara, I., Furukawa, T., Kato, T., Tanaka, S., and Kuroda, R. (2023). Measurement of shoulder abduction angle with posture estimation artificial intelligence model. Sensors, 23.10.3390/s23146445 ↗
27. Posture Estimation Model Combined With Machine Learning Estimates the Radial Abduction Angle of the Thumb With High Accuracy
28. Ehara, Y., Inui, A., Mifune, Y., Yamaura, K., Kato, T., Furukawa, T., Tanaka, S., Kusunose, M., Takigami, S., and Osawa, S. (2025). The development and validation of an artificial intelligence model for estimating thumb range of motion using angle sensors and machine learning: Targeting radial abduction, palmar abduction, and pronation angles. Appl. Sci., 15.10.3390/app15031296 ↗
29. Definition, criteria, and core concepts of guidelines for the management of obesity disease in Japan (JASSO 2022 Guideline)10.1507/endocrj.EJ23-0593 ↗
30. A comprehensive comparison of various machine learning algorithms used for predicting the splitting tensile strength of steel fiber-reinforced concrete
31. Hassan, M., and Kaabouch, N. (2024). Impact of feature selection techniques on the performance of machine learning models for depression detection using EEG data. Appl. Sci., 14.10.3390/app142210532 ↗
32. Enkhbayar, D., Ko, J., Oh, S., Ferdushi, R., Kim, J., Key, J., and Urtnasan, E. (2025). Explainable artificial intelligence models for predicting depression based on polysomnographic phenotypes. Bioengineering, 12.10.3390/bioengineering12020186 ↗
33. From local explanations to global understanding with explainable AI for trees10.1038/s42256-019-0138-9 ↗
34. In vivo 3D kinematics of normal forearms: Analysis of dynamic forearm rotation10.1016/j.clinbiomech.2010.07.006 ↗
35. Yoon, H., Jo, E., Ryu, S., Yoo, J., and Kim, J.H. (2022, January 6). MediaPipe-based LSTM-autoencoder sarcopenia anomaly detection and requirements for improving detection accuracy. Proceedings of the 1st International Workshop on Intelligent Software Engineering, CEUR Workshop Proceedings, Busan, Republic of Korea.