Improving Motion Intention Recognition for Trans-Radial Amputees Based on sEMG and Transfer Learning
Source abstract
Abstract
Hand motion intentions can be detected by analyzing the surface electromyographic (sEMG) signals obtained from the remaining forearm muscles of trans-radial amputees. This technology sheds new light on myoelectric prosthesis control; however, fewer signals from amputees can be collected in clinical practice. The collected signals can further suffer from quality deterioration due to the muscular atrophy of amputees, which significantly decreases the accuracy of hand motion intention recognition. To overcome these problems, this work proposed a transfer learning strategy combined with a long-exposure-CNN (LECNN) model to improve the amputees’ hand motion intention recognition accuracy. Transfer learning can leverage the knowledge acquired from intact-limb subjects to amputees, and LECNN can effectively capture the information in the sEMG signals. Two datasets with 20 intact-limb and 11 amputated-limb subjects from the Ninapro database were used to develop and evaluate the proposed method. The experimental results demonstrated that the proposed transfer learning strategy significantly improved the recognition performance (78.1%±19.9%, p-value < 0.005) compared with the non-transfer case (73.4%±20.8%). When the source and target data matched well, the after-transfer accuracy could be improved by up to 8.5%. Compared with state-of-the-art methods in two previous studies, the average accuracy was improved by 11.6% (from 67.5% to 78.1%, p-value < 0.005) and 12.1% (from 67.0% to 78.1%, p-value < 0.005). This result is also among the best from the contrast methods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Muscle activation and electromyography studies · EEG and Brain-Computer Interfaces · Neuroscience and Neural Engineering
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information Science and Technology, Dalian Maritime University, 1 Linghai Road, Ganjingzi District, Dalian 116026, China
Funding
Leading talent project of Dalian Maritime University
References (38)
Show source-provided references
1. The Basics of Electromyography10.1136/jnnp.2005.069211 ↗
2. Duan, B., Umeda, K., and Hwang, W. Design of the Human Surface Electromyogra Signal Acquisition System and Signal Analysis. Proceedings of the Seventh Asia International Symposium on Mechatronics.
3. Study on Flexible sEMG Acquisition System and Its Application in Muscle Strength Evaluation and Hand Rehabilitation10.3390/mi13122047 ↗
4. Surface Electromyography-Driven Parameters for Representing Muscle Mass and Strength10.3390/s23125490 ↗
5. Novel Functional Indices of Masticatory Muscle Activity10.3390/jcm10071440 ↗
6. Gesture Recognition Using Surface Electromyography and Deep Learning for Prostheses Hand: State-of-the-Art, Challenges, and Future10.3389/fnins.2021.621885 ↗
7. SEMG-Based Gesture Classifier for a Rehabilitation Glove10.3389/fnbot.2022.750482 ↗
8. Effect of clinical parameters on the control of myoelectric robotic prosthetic hands10.1682/JRRD.2014.09.0218 ↗
9. Neural Interfaces for Control of Upper Limb Prostheses: The State of the Art and Future Possibilities
10. Myoelectric Control Systems—A Survey10.1016/j.bspc.2007.07.009 ↗
11. Towards Reducing the Impacts of Unwanted Movements on Identification of Motion Intentions10.1016/j.jelekin.2016.03.005 ↗
12. Improving the Performance Against Force Variation of EMG Controlled Multifunctional Upper-Limb Prostheses for Transradial Amputees10.1109/TNSRE.2015.2445634 ↗
13. A Survey on Transfer Learning10.1109/TKDE.2009.191 ↗
14. Multi-Subject/Daily-Life Activity EMG-Based Control of Mechanical Hands10.1186/1743-0003-6-41 ↗
15. Matsubara, T., Hyon, S.-H., and Morimoto, J. (2011, January 7–11). Learning and Adaptation of a Stylistic Myoelectric Interface: EMG-Based Robotic Control with Individual User Differences. Proceedings of the 2011 IEEE International Conference on Robotics and Biomimetics, Karon Beach, Thailand.10.1109/ROBIO.2011.6181317 ↗
16. Adaptive Pattern Recognition of Myoelectric Signals: Exploration of Conceptual Framework and Practical Algorithms10.1109/TNSRE.2009.2023282 ↗
17. Park, K.-H., and Lee, S.-W. (2016, January 22–24). Movement Intention Decoding Based on Deep Learning for Multiuser Myoelectric Interfaces. Proceedings of the 2016 4th International Winter Conference on Brain-Computer Interface (BCI), Gangwon, Republic of Korea.10.1109/IWW-BCI.2016.7457459 ↗
18. Deep Learning for Electromyographic Hand Gesture Signal Classification Using Transfer Learning10.1109/TNSRE.2019.2896269 ↗
19. Improving SEMG-Based Motion Intention Recognition for Upper-Limb Amputees Using Transfer Learning10.1007/s00521-021-06292-0 ↗
20. Hand Gesture Recognition Based on Surface Electromyography Using Convolutional Neural Network with Transfer Learning Method10.1109/JBHI.2020.3009383 ↗
21. Surface EMG-Based Instantaneous Hand Gesture Recognition Using Convolutional Neural Network with the Transfer Learning Method10.3390/s21072540 ↗
22. Transfer Learning in Hand Movement Intention Detection Based on Surface Electromyography Signals10.3389/fnins.2022.977328 ↗
23. Ozdemir, M., Kisa, D., Guren, O., and Akan, A. (2022). Hand Gesture Classification Using Time-Frequency Images and Transfer Learning Based on CNN. Biomed. Signal Process. Control., 77.10.1016/j.bspc.2022.103787 ↗
24. Electromyography Data for Non-Invasive Naturally-Controlled Robotic Hand Prostheses10.1038/sdata.2014.53 ↗
25. Burhan, N., Kasno, M., and Ghazali, R. (2016, January 22–22). Feature Extraction of Surface Electromyography (SEMG) and Signal Processing Technique in Wavelet Transform: A Review. Proceedings of the 2016 IEEE International Conference on Automatic Control and Intelligent Systems (I2CACIS), Selangor, Malaysia.10.1109/I2CACIS.2016.7885304 ↗
26. A Real-Time Capable Linear Time Classifier Scheme for Anticipated Hand Movements Recognition from Amputee Subjects Using Surface EMG Signals10.1016/j.irbm.2020.08.003 ↗
27. EMG Pattern Recognition in the Era of Big Data and Deep Learning10.3390/bdcc2030021 ↗
28. Gesture Recognition by Instantaneous Surface EMG Images10.1038/srep36571 ↗
29. Surface EMG-Based Inter-Session Gesture Recognition Enhanced by Deep Domain Adaptation10.3390/s17030458 ↗
30. Long Exposure Convolutional Memory Network for Accurate Estimation of Finger Kinematics from Surface Electromyographic Signals10.1088/1741-2552/abd461 ↗
31. Yosinski, J., Clune, J., Bengio, Y., and Lipson, H. (2014). Advances in Neural Information Processing Systems, Curran Associates, Inc.
32. Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands10.3389/fnbot.2016.00009 ↗
33. Resilient EMG Classification to Enable Reliable Upper-Limb Movement Intent Detection10.1109/TNSRE.2020.3024947 ↗
34. Enhancing the Classification of Hand Movements through SEMG Signal and Non-Iterative Methods10.1007/s12553-019-00315-6 ↗
35. Statistical Feature and Channel Selection for Upper Limb Classification Using SEMG Signal Processing10.1007/s42600-020-00080-w ↗
36. Self-Recalibrating Surface EMG Pattern Recognition for Neuroprosthesis Control Based on Convolutional Neural Network10.3389/fnins.2017.00379 ↗
37. Gregori, V., Gijsberts, A., and Caputo, B. (2017, January 17–20). Adaptive Learning to Speed-up Control of Prosthetic Hands: A Few Things Everybody Should Know. Proceedings of the 2017 International Conference on Rehabilitation Robotics (ICORR), London, UK.10.1109/ICORR.2017.8009401 ↗
38. Wang, H., Fang, P., Tian, L., Zheng, Y., Zhou, H., Li, G., and Zhang, X. (2015, January 25–29). Towards Determining the Afferent Sites of Perception Feedback on Residual Arms of Amputees with Transcutaneous Electrical Stimulation. Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy.