journal article·2023-04-11Open access

Leg-Joint Angle Estimation from a Single Inertial Sensor Attached to Various Lower-Body Links during Walking Motion

Tsige Tadesse Alemayoh, Jae Hoon Lee, Shingo Okamoto

Applied Sciences· Volume 13· Issue 8

Abstract

Gait analysis is important in a variety of applications such as animation, healthcare, and virtual reality. So far, high-cost experimental setups employing special cameras, markers, and multiple wearable sensors have been used for indoor human pose-tracking and gait-analysis purposes. Since locomotive activities such as walking are rhythmic and exhibit a kinematically constrained motion, fewer wearable sensors can be employed for gait and pose analysis. One of the core parts of gait analysis and pose-tracking is lower-limb-joint angle estimation. Therefore, this study proposes a neural network-based lower-limb-joint angle-estimation method from a single inertial sensor unit. As proof of concept, four different neural-network models were investigated, including bidirectional long short-term memory (BLSTM), convolutional neural network, wavelet neural network, and unidirectional LSTM. Not only could the selected network affect the estimation results, but also the sensor placement. Hence, the waist, thigh, shank, and foot were selected as candidate inertial sensor positions. From these inertial sensors, two sets of lower-limb-joint angles were estimated. One set contains only four sagittal-plane leg-joint angles, while the second includes six sagittal-plane leg-joint angles and two coronal-plane leg-joint angles. After the assessment of different combinations of networks and datasets, the BLSTM network with either shank or thigh inertial datasets performed well for both joint-angle sets. Hence, the shank and thigh parts are the better candidates for a single inertial sensor-based leg-joint estimation. Consequently, a mean absolute error (MAE) of 3.65° and 5.32° for the four-joint-angle set and the eight-joint-angle set were obtained, respectively. Additionally, the actual leg motion was compared to a computer-generated simulation of the predicted leg joints, which proved the possibility of estimating leg-joint angles during walking with a single inertial sensor unit.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Gait Recognition and Analysis · Diabetic Foot Ulcer Assessment and Management · Balance, Gait, and Falls Prevention

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Mechanical Engineering, Graduate School of Science and Engineering, Ehime University, Bunkyo-cho 3, Matsuyama 790-8577, Japan

Funding

JSPS KAKENHI

References (35)

Show source-provided references
1. How we Walk: Central Control of Muscle Activity during Human Walking
2. One-year persistence of individual gait patterns identified in a follow-up study—A call for individualised diagnose and therapy10.1016/j.gaitpost.2017.09.003 ↗
3. Quantified self and human movement: A review on the clinical impact of wearable sensing and feedback for gait analysis and intervention10.1016/j.gaitpost.2014.03.189 ↗
4. Gait analysis as a quantifiable outcome measure in hip or knee osteoarthritis: A systematic review10.1016/j.jbspin.2009.12.009 ↗
5. Gait variability and fall risk in community living older adults: A 1-year pro-spective study10.1053/apmr.2001.24893 ↗
6. Glowinski, S., Łosi, K., Kowia, P., Wa, M., Bryndal, A., and Grochulska, A. (2020). Inertial sensors as a tool for diagnosing discopathy lumbosacral pathologic gait: A preliminary research. Diagnostics, 10.10.3390/diagnostics10060342 ↗
7. Rovini, E., Maremmani, C., and Cavallo, F. (2020). A Wearable System to Objectify Assessment of Motor Tasks for Supporting Parkinson’s Disease Diagnosis. Sensors, 20.10.3390/s20092630 ↗
8. Improvement in balance using a virtual reality-based stepping exercise: A randomized controlled trial involving individuals with chronic stroke10.1177/0269215514543333 ↗
9. Shull, P., Lurie, K., Shin, M., Besier, T., and Cutkosky, M. (2010, January 25–26). Haptic gait retraining for knee osteoarthritis treatment. Proceedings of the 2010 IEEE Haptics Symposium, Waltham, MA, USA.10.1109/HAPTIC.2010.5444625 ↗
10. Human movement and ergonomics: An industry-oriented dataset for collaborative robotics10.1177/0278364919882089 ↗
11. Ke, S.-R., Zhu, L., Hwang, J.-N., Pai, H.-I., Lan, K.-M., and Liao, C.-P. (September, January 29). Real-Time 3D Human Pose Estimation from Monocular View with Applications to Event Detection and Video Gaming. Proceedings of the 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance, Boston, MA, USA.10.1109/AVSS.2010.80 ↗
12. Merriaux, P., Dupuis, Y., Boutteau, R., Vasseur, P., and Savatier, X. (2017). A Study of Vicon System Positioning Performance. Sensors, 17.10.3390/s17071591 ↗
13. Luo, Y., Li, Y., Foshey, M., Shou, W., Sharma, P., Palacios, T., Torralba, A., and Matusik, W. (2021, January 20–25). Intelligent Carpet: Inferring 3D Human Pose from Tactile Signals. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.01110 ↗
14. Yang, W., Ouyang, W., Li, H., and Wang, X. (2016, January 27–30). End-to-End Learning of Deformable Mixture of Parts and Deep Convolutional Neural Networks for Human Pose Estimation. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.335 ↗
15. Newell, A., Yang, K., and Deng, J. (2016). European Conference on Computer Vision, Springer.
16. Sun, X., Xiao, B., Wei, F., Liang, S., and Wei, Y. (2018, January 8–14). Integral human pose regression. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01231-1_33 ↗
17. Unobtrusive, Continuous, In-Home Gait Measurement Using the Microsoft Kinect10.1109/TBME.2013.2266341 ↗
18. Al-Amri, M., Nicholas, K., Button, K., Sparkes, V., Sheeran, L., and Davies, J.L. (2018). Inertial Measurement Units for Clinical Movement Analysis: Reliability and Concurrent Validity. Sensors, 18.10.3390/s18030719 ↗
19. Validity and reliability of accelerations and orientations measured using wearable sensors during functional activities10.1038/s41598-022-18845-x ↗
20. Sy, L., Lovell, N., and Redmond, S. (2020). Estimating Lower Limb Kinematics Using a Lie Group Constrained Extended Kalman Filter with a Reduced Wearable IMU Count and Distance Measurements. Sensors, 20.10.20944/preprints202011.0166.v1 ↗
21. de Almeida, T.F., Morya, E., Rodrigues, A.C., and de Azevedo Dantas, A.F.O. (2021). Development of a Low-Cost Open-Source Measurement System for Joint Angle Estimation. Sensors, 21.10.3390/s21196477 ↗
22. Lee, T., Kim, I., and Lee, S.-H. (2021). Estimation of the Continuous Walking Angle of Knee and Ankle (Talocrural Joint, Subtalar Joint) of a Lower-Limb Exoskeleton Robot Using a Neural Network. Sensors, 21.10.3390/s21082807 ↗
23. Alemayoh, T.T., Lee, J.H., and Okamoto, S. (2022, January 21–24). LocoESIS: Deep-Learning-Based Leg-Joint Angle Estimation from a Single Pelvis Inertial Sensor. Proceedings of the 2022 9th IEEE RAS/EMBS International Conference for Biomedical Robotics and Biomechatronics (BioRob), Seoul, Republic of Korea.10.1109/BioRob52689.2022.9925420 ↗
24. Chen, S., Bangaru, S.S., Yigit, T., Trkov, M., Wang, C., and Yi, J. (2021, January 12–16). Real-Time Walking Gait Estimation for Construction Workers Using a Single Wearable Inertial Measurement Unit (IMU). Proceedings of the 2021 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), Delft, The Netherlands.10.1109/AIM46487.2021.9517592 ↗
25. Sung, J., Han, S., Park, H., Cho, H.-M., Hwang, S., Park, J.W., and Youn, I. (2022). Prediction of Lower Extremity Multi-Joint Angles during Overground Walking by Using a Single IMU with a Low Frequency Based on an LSTM Recurrent Neural Network. Sensors, 22.10.3390/s22010053 ↗
26. Mundt, M., Johnson, W., Potthast, W., Markert, B., Mian, A., and Alderson, J. (2021). A Comparison of Three Neural Network Approaches for Estimating Joint Angles and Moments from Inertial Measurement Units. Sensors, 21.10.3390/s21134535 ↗
27. Xsens MVN: Consistent Tracking of Human Motion Using Inertial Sensing
28. Concurrent validation of Xsens MVN measurement of lower limb joint angular kinematics10.1088/0967-3334/34/8/N63 ↗
29. Cortical Correlates of Locomotor Muscle Synergy Activation in Humans: An Electroencephalographic Decoding Study10.1016/j.isci.2019.04.008 ↗
30. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
31. Elsworth, S., and Guttel, S. (2020). Time Series Forecasting Using LSTM Networks: A Symbolic Approach. arXiv.
32. Framewise phoneme classification with bidirectional LSTM and other neural network architectures10.1016/j.neunet.2005.06.042 ↗
33. Convolutional Neural Network-Based Human Movement Recognition Algorithm in Sports Analysis10.3389/fpsyg.2021.663359 ↗
34. Alemayoh, T., Lee, J., and Okamoto, S. (2021). New Sensor Data Structuring for Deeper Feature Extraction in Human Activity Recognition. Sensors, 21.10.3390/s21082814 ↗
35. An explainable and interpretable model for attention deficit hyperactivity disorder in children using EEG signals10.1016/j.compbiomed.2023.106676 ↗