journal article·2024-09-09Open access

Transfer Learning and Deep Neural Networks for Robust Intersubject Hand Movement Detection from EEG Signals

Chiang Liang Kok, Chee Kit Ho, Thein Htet Aung, Yit Yan Koh, Tee Hui Teo

Applied Sciences· Volume 14· Issue 17

Abstract

In this research, five systems were developed to classify four distinct motor functions—forward hand movement (FW), grasp (GP), release (RL), and reverse hand movement (RV)—from EEG signals, using the WAY-EEG-GAL dataset where participants performed a sequence of hand movements. During preprocessing, band-pass filtering was applied to remove artifacts and focus on the mu and beta frequency bands. The initial system, a preliminary study model, explored the overall framework of EEG signal processing and classification, utilizing time-domain features such as variance and frequency-domain features such as alpha and beta power, with a KNN model for classification. Insights from this study informed the development of a baseline system, which innovatively combined the common spatial patterns (CSP) method with continuous wavelet transform (CWT) for feature extraction and employed a GoogLeNet classifier with transfer learning. This system classified six unique pairs of events derived from the four motor functions, achieving remarkable accuracy, with the highest being 99.73% for the GP–RV pair and the lowest 80.87% for the FW–GP pair in intersubject classification. Building on this success, three additional systems were developed for four-way classification. The final model, ML-CSP-OVR, demonstrated the highest intersubject classification accuracy of 78.08% using all combined data and 76.39% for leave-one-out intersubject classification. This proposed model, featuring a novel combination of CSP-OVR, CWT, and GoogLeNet, represents a significant advancement in the field, showcasing strong potential as a general system for motor imagery (MI) tasks that is not dependent on the subject. This work highlights the prominence of the research contribution by demonstrating the effectiveness and robustness of the proposed approach in achieving high classification accuracy across different motor functions and subjects.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: EEG and Brain-Computer Interfaces · Muscle activation and electromyography studies · ECG Monitoring and Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Engineering, Science and Environment, University of Newcastle, Callaghan, NSW 2308, Australia

Engineering Cluster, Singapore Institute of Technology, Singapore 138683, Singapore

Engineering Product Development, Science, Mathematics and Technology, Singapore University of Technology and Design, Singapore 487372, Singapore

References (63)

Show source-provided references
1. Paszkiel, S., and Szpulak, P. (2018). Methods of acquisition, archiving and biomedical data analysis of brain functioning. Biomedical Engineering and Neuroscience, Proceedings of the 3rd International Scientific Conference on Brain-Computer Interfaces, BCI 2018, Opole, Poland, 13–14 March 2018, Springer.10.1007/978-3-319-75025-5_15 ↗
2. Analysis of Electroencephalography (EEG) Signals and Its Categorization: A Study10.1016/j.proeng.2012.06.298 ↗
3. Hu, L., and Zhang, Z. (2019). EEG Signal Processing and Feature Extraction, Springer.10.1007/978-981-13-9113-2 ↗
4. Event-related EEG/MEG synchronization and desynchronization: Basic principles10.1016/S1388-2457(99)00141-8 ↗
5. Tayeb, Z., Fedjaev, J., Ghaboosi, N., Richter, C., Everding, L., Qu, X., Wu, Y., Cheng, G., and Conradt, J. (2019). Validating deep neural networks for online decoding of motor imagery movements from EEG signals. Sensors, 19.10.3390/s19010210 ↗
6. Neural Simulation of Action: A Unifying Mechanism for Motor Cognition10.1006/nimg.2001.0832 ↗
7. History and evolution of electroencephalographic instruments and techniques10.1097/00004691-199310000-00007 ↗
8. Mahmood, A., Zainab, R., Ahmad, R.B., Saeed, M., and Kamboh, A.M. (2017, January 11–15). Classification of multi-class motor imagery EEG using four band common spatial pattern. Proceedings of the 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Jeju, Republic of Korea.10.1109/EMBC.2017.8037003 ↗
9. Designing optimal spatial filters for single-trial EEG classification in a movement task10.1016/S1388-2457(98)00038-8 ↗
10. Optimal spatial filtering of single trial EEG during imagined hand movement10.1109/86.895946 ↗
11. Optimizing Spatial filters for Robust EEG Single-Trial Analysis10.1109/MSP.2008.4408441 ↗
12. Wu, W., Gao, X., and Gao, S. (2006, January 17–18). One-versus-the-rest (OVR) algorithm: An extension of common spatial patterns (CSP) algorithm to multi-class case. Proceedings of the 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference, Shanghai, China.
13. Ang, K.K., Chin, Z.Y., Wang, C., Guan, C., and Zhang, H. (2012). Filter bank common spatial pattern algorithm on BCI competition IV datasets 2a and 2b. Front. Neurosci., 6.10.3389/fnins.2012.00039 ↗
14. Learning common time-frequency-spatial patterns for motor imagery classification10.1109/TNSRE.2021.3071140 ↗
15. Sun, G., Hu, J., and Wu, G. (2010, January 18–23). A novel frequency band selection method for common spatial pattern in motor imagery based brain computer interface. Proceedings of the 2010 International Joint Conference on Neural Networks (IJCNN), Barcelona, Spain.10.1109/IJCNN.2010.5596474 ↗
16. Korhan, N., Dokur, Z., and Olmez, T. (2019, January 24–26). Motor imagery based EEG classification by using common spatial patterns and convolutional neural networks. Proceedings of the 2019 Scientific Meeting on Electrical-Electronics & Biomedical Engineering and Computer Science (EBBT), Istanbul, Turkey.10.1109/EBBT.2019.8741832 ↗
17. Yahya, N., Musa, H., Ong, Z.Y., and Elamvazuthi, I. (2019). Classification of motor functions from electroencephalogram (EEG) signals based on an integrated method comprised of common spatial pattern and wavelet transform framework. Sensors, 19.10.3390/s19224878 ↗
18. Zhang, C., and Eskandarian, A. (2020, January 20–24). A computationally efficient multiclass time-frequency common spatial pattern analysis on EEG motor imagery. Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Montreal, QC, Canada.10.1109/EMBC44109.2020.9176705 ↗
19. Li, S., and Feng, H. (2019, January 5–7). EEG signal classification method based on feature priority analysis and CNN. Proceedings of the 2019 International Conference on Communications, Information System and Computer Engineering (CISCE), Haikou, China.10.1109/CISCE.2019.00095 ↗
20. Muñoz, G.R. (October, January 30). Analysis and classification of electroencephalographic signals (EEG) to identify arm movements. Proceedings of the 2013 10th International Conference on Electrical Engineering, Computing Science and Automatic Control (CCE), Mexico City, Mexico.
21. Alomari, M.H., Samaha, A., and AlKamha, K. (2013). Automated classification of L/R hand movement EEG signals using advanced feature extraction and machine learning. arXiv.
22. Shedeed, H.A., Issa, M.F., and El-Sayed, S.M. (2013, January 26–28). Brain EEG signal processing for controlling a robotic arm. Proceedings of the 2013 8th International Conference on Computer Engineering & Systems (ICCES), Cairo, Egypt.10.1109/ICCES.2013.6707191 ↗
23. Ramadhan, M.M., Wijaya, S.K., and Prajitno, P. (2019, January 16–18). Classification of EEG signals from motor imagery of hand grasp movement based on neural network approach. Proceedings of the 2019 IEEE International Conference on Signals and Systems (ICSigSys), Bandung, Indonesia.10.1109/ICSIGSYS.2019.8811017 ↗
24. Zhou, X., Zou, R., and Huang, X. (2021). Single upper limb functional movements decoding from motor imagery EEG signals using wavelet neural network. Biomed. Signal Process. Control, 70.10.1016/j.bspc.2021.102965 ↗
25. Wavelet neural networks: A practical guide10.1016/j.neunet.2013.01.008 ↗
26. Kok, C.L., Ho, C.K., Tan, F.K., and Koh, Y.Y. (2024). Machine Learning-Based Feature Extraction and Classification of EMG Signals for Intuitive Prosthetic Control. Appl. Sci., 14.10.3390/app14135784 ↗
27. EEG artifact removal—State-of-the-art and guidelines10.1088/1741-2560/12/3/031001 ↗
28. A Deep Learning Scheme for Motor Imagery Classification based on Restricted Boltzmann Machines10.1109/TNSRE.2016.2601240 ↗
29. Classification of Hand Movements from EEG Using a Deep Attention-Based LSTM Network10.1109/JSEN.2019.2956998 ↗
30. Kok, C.L., Ho, C.K., Dai, Y., Lee, T.K., Koh, Y.Y., and Chai, J.P. (2024). A Novel and Self-Calibrating Weighing Sensor with Intelligent Peristaltic Pump Control for Real-Time Closed-Loop Infusion Monitoring in IoT-Enabled Sustainable Medical Devices. Electronics, 13.10.3390/electronics13091724 ↗
31. The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms10.1109/TAU.1967.1161901 ↗
32. Gao, R.X., and Yan, R. (2011). From Fourier Transform to Wavelet Transform: A Historical Perspective. Wavelets: Theory and Applications for Manufacturing, Springer.10.1007/978-1-4419-1545-0_2 ↗
33. Application of wavelet transform and its advantages compared to Fourier transform
34. K-nearest neighbor10.4249/scholarpedia.1883 ↗
35. Artificial neural networks: A tutorial10.1109/2.485891 ↗
36. O’Shea, K., and Nash, R. (2015). An introduction to convolutional neural networks. arXiv.
37. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
38. Chen, J., Teo, T.H., Kok, C.L., and Koh, Y.Y. (2024). A Novel Single-Word Speech Recognition on Embedded Systems Using a Convolution Neuron Network with Improved Out-of-Distribution Detection. Electronics, 13.10.3390/electronics13030530 ↗
39. EEG signal classification using wavelet feature extraction and a mixture of expert model10.1016/j.eswa.2006.02.005 ↗
40. Bashivan, P., Rish, I., Yeasin, M., and Codella, N. (2016, January 2–4). Learning representations from EEG with deep recurrent-convolutional neural networks. Proceedings of the IEEE International Conference on Learning Representations, San Juan, Puerto Rico.
41. Combination of EEG complexity and spectral analysis for epilepsy diagnosis and seizure detection10.1155/2010/853434 ↗
42. EEG-based emotion recognition using deep learning network with principal component based covariate shift adaptation10.1155/2014/627892 ↗
43. Mu rhythm (de) synchronization and EEG single-trial classification of different motor imagery tasks10.1016/j.neuroimage.2005.12.003 ↗
44. Brain wave classification using long short-term memory network based OPTICAL algorithm
45. Kok, C.L., Dai, Y., Lee, T.K., Koh, Y.Y., Teo, T.H., and Chai, J.P. (2024). A Novel Low-Cost Capacitance Sensor Solution for Real-Time Bubble Monitoring in Medical Infusion Devices. Electronics, 13.10.3390/electronics13061111 ↗
46. Epileptic seizure detection using lacunarity and Bayesian linear discriminant analysis in intracranial EEG10.1109/TBME.2013.2254486 ↗
47. Classification of EEG signals using a multiple kernel learning support vector machine
48. EEG signal classification using Fourier Transform
49. Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals10.1016/j.compbiomed.2017.09.017 ↗
50. Multi-channel EEG recordings during 3,936 grasp and lift trials with varying weight and friction10.1038/sdata.2014.47 ↗
51. Aung, K.H.H., Kok, C.L., Koh, Y.Y., and Teo, T.H. (2024). An Embedded Machine Learning Fault Detection System for Electric Fan Drive. Electronics, 13.10.3390/electronics13030493 ↗
52. Lin, M., Chen, Q., and Yan, S. (2013). Network in network. arXiv.
53. Kok, C.L., Fu, X., Koh, Y.Y., and Teo, T.H. (2024). A Novel Portable Solar Powered Wireless Charging Device. Electronics, 13.10.3390/electronics13020403 ↗
54. The continuous wavelet transform: A tool for signal investigation and understanding
55. Cohen, M.X. (2021). A tutorial on generalized eigen decomposition for source separation in multichannel electrophysiology. arXiv.
56. EEG Signal Classification Using Deep Learning Techniques for Brain-Computer Interfaces
57. Feature Extraction and Classification of EEG Signals Using Wavelet Transform and Support Vector Machines
58. Comparative Analysis of ICA and PCA for EEG Signal Denoising and Classification
59. Li, F., He, F., Wang, F., Zhang, D., Xia, Y., and Li, X. (2020). A Novel Simplified Convolutional Neural Network Classification Algorithm of Motor Imagery EEG Signals Based on Deep Learning. Appl. Sci., 10.10.3390/app10051605 ↗
60. Kok, C.L., Tan, T.C., Koh, Y.Y., Lee, T.K., and Chai, J.P. (2024). Design and Testing of an Intramedullary Nail Implant Enhanced with Active Feedback and Wireless Connectivity for Precise Limb Lengthening. Electronics, 13.10.3390/electronics13081519 ↗
61. A systematic analysis of performance measures for classification tasks10.1016/j.ipm.2009.03.002 ↗
62. Kok, C.L., Ho, C.K., Lee, T.K., Loo, Z.Y., Koh, Y.Y., and Chai, J.P. (2024). A Novel and Low-Cost Cloud-Enabled IoT Integration for Sustainable Remote Intravenous Therapy Management. Electronics, 13.10.3390/electronics13101801 ↗
63. MarsScapes and UDAFormer: A Panorama Dataset and a Transformer-Based Unsupervised Domain Adaptation Framework for Martian Terrain Segmentation