journal article·2025-10-16Open access

A Parallel Network for Continuous Motion Estimation of Finger Joint Angles with Surface Electromyographic Signals

Chuang Lin, Shengshuo Zhou

Applied Sciences· Volume 15· Issue 20

Abstract

The implementation of surface electromyographic (sEMG) signals in the interaction between human beings and machines is an important line of research. In the system of human–machine interaction, continuous-motion-estimation-based control plays an important role because it is more natural and intuitive than pattern recognition-based control. In this paper, we propose a parallel network consisting of a CNN with a multi-head attention mechanism and a BiLSTM (bidirectional long short-term memory) network to improve the accuracy of continuous motion estimation. The proposed network is evaluated in the Ninapro dataset. Six finger movements of 10 subjects were tested in the Ninapro DB2 dataset to evaluate the performance of the neural network and calculate the PCC (Pearson Correlation Coefficient) between the predicted joint angle sequence and the actual joint angle sequence. The experimental results show that the average accuracy (PCC) of the proposed network reaches 0.87 ± 0.02, which is significantly better than that of the BiLSTM network (0.79 ± 0.04, p < 0.05), CNN-Attention (0.80 ± 0.01, p < 0.05), CNN (0.70 ± 0.03, p < 0.05), CNN-BiLSTM (0.83 ± 0.02, p < 0.05), and TCN (0.76 ± 0.05, p < 0.05). It is worth noting that in this work, we extract multiple features from the raw sEMG signals and fuse them. We found that better continuous estimation accuracy can be achieved using multi-feature sEMG data. The model proposed in this paper skillfully integrates the convolutional neural network, multi-head attention mechanism, and bidirectional long short-term memory network, and its performance has good stability and accuracy. The model realizes more natural and accurate human–computer interaction.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Muscle activation and electromyography studies · Hand Gesture Recognition Systems · Gaze Tracking and Assistive Technology

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information Science and Technology, Dalian Maritime University, Dalian 116026, China

Funding

Dalian Maritime University

References (29)

Show source-provided references
1. Deep Learning for EMG-based Human-Machine Interaction: A Review10.1109/JAS.2021.1003865 ↗
2. Benalcázar, M.E., González, J., Jaramillo-Yánez, A., Anchundia, C.E., Zambrano, P., and Segura, M. (2020, January 13–16). A Model for Real-Time Hand Gesture Recognition Using Electromyography (EMG), Covariances and Feed-Forward Artificial Neural Networks. Proceedings of the 2020 IEEE ANDESCON, Quito, Ecuador.10.1109/ANDESCON50619.2020.9271979 ↗
3. Kaplan, K.E., Nichols, K.A., and Okamura, A.M. (2016, January 16–21). Toward human-robot collaboration in surgery: Performance assessment of human and robotic agents in an inclusion segmentation task. Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.10.1109/ICRA.2016.7487199 ↗
4. Current state of digital signal processing in myoelectric interfaces and related applications10.1016/j.bspc.2015.02.009 ↗
5. EMG-based Robot Control Interfaces: Past, Present and Future10.4172/2168-9695.1000e107 ↗
6. Chen, J., Bi, S., Zhang, G., and Cao, G. (2020). High-Density Surface EMG-Based Gesture Recognition Using a 3D Convolutional Neural Network. Sensors, 20.10.3390/s20041201 ↗
7. Park, K.H., and Lee, S.W. (2016, January 22–24). Movement intention decoding based on deep learning for multiuser myoelectric interfaces. Proceedings of the 2016 4th International Winter Conference on Brain-Computer Interface (BCI), Gangwon, Republic of Korea.10.1109/IWW-BCI.2016.7457459 ↗
8. A review on EMG-based motor intention prediction of continuous human upper limb motion for human-robot collaboration10.1016/j.bspc.2019.02.011 ↗
9. Influence of Joint Angle on EMG-Torque Model During Constant-Posture, Torque-Varying Contractions10.1109/TNSRE.2015.2405765 ↗
10. Prediction of joint moments using a neural network model of muscle activations from EMG signals10.1109/TNSRE.2002.1021584 ↗
11. A Continuous Estimation Model of Upper Limb Joint Angles by Using Surface Electromyography and Deep Learning Method10.1109/ACCESS.2019.2956951 ↗
12. MyoNet: A Transfer-Learning-Based LRCN for Lower Limb Movement Recognition and Knee Joint Angle Prediction for Remote Monitoring of Rehabilitation Progress From sEMG10.1109/JTEHM.2020.2972523 ↗
13. Cross-Comparison of EMG-to-Force Methods for Multi-DoF Finger Force Prediction Using One-DoF Training10.1109/ACCESS.2020.2966007 ↗
14. A Novel and Efficient Feature Extraction Method for Deep Learning Based Continuous Estimation10.1109/LRA.2021.3097257 ↗
15. Zhang, J., Chen, X., Jandaghi, E., Zeng, W., Zhou, M., and Yuan, C. (June, January 31). Dynamics Learning-Based Fault Isolation for A Soft Trunk Robot. Proceedings of the 2023 American Control Conference (ACC), San Diego, CA, USA.10.23919/ACC55779.2023.10156314 ↗
16. Jandaghi, E., Chen, X., and Yuan, C. (2023, January 28–30). Motion Dynamics Modeling and Fault Detection of a Soft Trunk Robot. Proceedings of the 2023 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), Seattle, WA, USA.10.1109/AIM46323.2023.10196206 ↗
17. Bodaghi, M., Hosseini, M., and Gottumukkala, R. (2024). A Multimodal Intermediate Fusion Network with Manifold Learning for Stress Detection. arXiv.10.1109/ICMI60790.2024.10586177 ↗
18. Atzori, M., and Muller, H. (2015, January 25–29). The Ninapro database: A resource for sEMG naturally controlled robotic hand prosthetics. Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy.10.1109/EMBC.2015.7320041 ↗
19. EMG-Based Continuous Control Scheme with Simple Classifier for Electric-Powered Wheelchair10.1109/TIE.2016.2522385 ↗
20. Siami-Namini, S., Tavakoli, N., and Namin, A.S. (2019, January 9–12). The Performance of LSTM and BiLSTM in Forecasting Time Series. Proceedings of the 2019 IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA.10.1109/BigData47090.2019.9005997 ↗
21. Sentiment Analysis of Comment Texts Based on BiLSTM10.1109/ACCESS.2019.2909919 ↗
22. A Bi-Directional LSTM Network for Estimating Continuous Upper Limb Movement from Surface Electromyography10.1109/LRA.2021.3097272 ↗
23. Bai, S., Kolter, J.Z., and Koltun, V. (2018). An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling. arXiv.
24. Zanghieri, M., Benatti, S., Conti, F., Burrello, A., and Benini, L. (September, January 31). Temporal Variability Analysis in sEMG Hand Grasp Recognition using Temporal Convolutional Networks. Proceedings of the 2020 2nd IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS), Genova, Italy.10.1109/AICAS48895.2020.9073888 ↗
25. Distributed Attention-Based Temporal Convolutional Network for Remaining Useful Life Prediction10.1109/JIOT.2020.3004452 ↗
26. Multi-task learning for segmentation and classification of tumors in 3D automated breast ultrasound images10.1016/j.media.2020.101918 ↗
27. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention Is All You Need. arXiv.
28. Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv.
29. A Classification Method for Myoelectric Control of Hand Prostheses Inspired by Muscle Coordination10.1109/TNSRE.2018.2861774 ↗