journal article·2022-06-07Open access

Multi-Classification of Motor Imagery EEG Signals Using Bayesian Optimization-Based Average Ensemble Approach

Souha Kamhi, Shuai Zhang, Mohamed Ait Amou, Mohamed Mouhafid, Imran Javaid, Isah Salim Ahmad, Isselmou Abd El Kader, Ummay Kulsum

Applied Sciences· Volume 12· Issue 12

Abstract

Motor Imagery (MI) classification using electroencephalography (EEG) has been extensively applied in healthcare scenarios for rehabilitation aims. EEG signal decoding is a difficult process due to its complexity and poor signal-to-noise ratio. Convolutional neural networks (CNN) have demonstrated their ability to extract time–space characteristics from EEG signals for better classification results. However, to discover dynamic correlations in these signals, CNN models must be improved. Hyperparameter choice strongly affects the robustness of CNNs. It is still challenging since the manual tuning performed by domain experts lacks the high performance needed for real-life applications. To overcome these limitations, we presented a fusion of three optimum CNN models using the Average Ensemble strategy, a method that is utilized for the first time for MI movement classification. Moreover, we adopted the Bayesian Optimization (BO) algorithm to reach the optimal hyperparameters’ values. The experimental results demonstrate that without data augmentation, our approach reached 92% accuracy, whereas Linear Discriminate Analysis, Support Vector Machine, Random Forest, Multi-Layer Perceptron, and Gaussian Naive Bayes achieved 68%, 70%, 58%, 64%, and 40% accuracy, respectively. Further, we surpassed state-of-the-art strategies on the BCI competition IV-2a multiclass MI database by a wide margin, proving the benefit of combining the output of CNN models with automated hyperparameter tuning.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: EEG and Brain-Computer Interfaces · Blind Source Separation Techniques · ECG Monitoring and Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin 300130, China

Hebei Key Laboratory of Bioelectromagnetism and Neural Engineering, School of Health Sciences & Biomedical Engineering, Hebei University of Technology, Tianjin 300130, China

School of Electronics and Information Engineering, Hebei University of Technology, Tianjin 300401, China

Funding

Natural Science Foundation of China

References (40)

Show source-provided references
1. P300-based brain computer interface: Reliability and performance in healthy and paralysed participants10.1016/j.clinph.2005.07.024 ↗
2. Schalk, G., and Mellinger, J. (2010). Brain sensors and signals. A Practical Guide to Brain–Computer Interfacing with BCI2000, Springer.10.1007/978-1-84996-092-2 ↗
3. Motor imagery and action observation: Cognitive tools for rehabilitation10.1007/s00702-007-0763-z ↗
4. Motor imagery EEG recognition based on conditional optimization empirical mode decomposition and multi-scale convolutional neural network10.1016/j.eswa.2020.113285 ↗
5. Literature Review on EEG Preprocessing, Feature Extraction, and Classifications Techniques10.21608/mjeer.2019.64927 ↗
6. Classification of patterns of EEG synchronization for seizure prediction10.1016/j.clinph.2009.09.002 ↗
7. Towards brain big data classification: Epileptic EEG identification with a lightweight VGGNet on global MIC10.1109/ACCESS.2018.2810882 ↗
8. Classification of early-stage Parkinson’s disease in EEG and tremor timefrequency features space10.1016/j.parkreldis.2015.10.393 ↗
9. Brunner, C., Leeb, R., Muller-Putz, G., Schlogl, A., and Pfurtscheller, G. (2008). BCI Competition 2008—Graz Data Set A, Graz University of Technology.
10. A Two-Stage Linear Discriminant Analysis via QR Decomposition10.1109/TPAMI.2005.110 ↗
11. Vapnik, V. (1995). The Nature of Statistical Learning Theory, Springer.10.1007/978-1-4757-2440-0 ↗
12. Automated sleep stage identification system based on timefrequency analysis of a single EEG channel and random forest classifier10.1016/j.cmpb.2011.11.005 ↗
13. Detection of Epileptic Electroencephalogram Based on Permutation Entropy and Support Vector Machines10.1016/j.eswa.2011.07.008 ↗
14. Kassam, K.S., Markey, A.R., Cherkassky, V.L., Loewenstein, G., and Just, M.A. (2013). Identifying emotions on the basis of neural activation. PLoS ONE, 8.10.1371/journal.pone.0066032 ↗
15. Multiclass EEG motor-imagery classification with sub-band common spatial patterns10.1186/s13638-019-1497-y ↗
16. Bhattacharyya, S., Khasnobish, A., Konar, A., Tibarewala, D.N., and Nagar, A.K. (2011, January 11–15). Performance analysis of left/right hand movement classification from EEG signal by intelligent algorithms. Proceedings of the 2011 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB), Paris, France.10.1109/CCMB.2011.5952111 ↗
17. BCI Competition II (2022, January 13). Berlin Brain-Computer Interface (BBCI). Available online: https://www.bbci.de/competition/ii/.
18. Improved Motor Imagery Classification Using Regularized Common Spatial Pattern with Majority Voting Strategy10.1016/j.ifacol.2021.11.179 ↗
19. Yang, H., Sakhavi, S., Ang, K.K., and Guan, C. (2015, January 25–29). On the use of convolutional neural networks and augmented CSP features for multi-class motor imagery of EEG signals classification. Proceedings of the 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Milan, Italy.
20. Cheng, P., Autthasan, P., Pijarana, B., Chuangsuwanich, E., and Wilaiprasitporn, T. (2018, January 28–31). Towards asynchronous motor imagery-based brain-computer interfaces: A joint training scheme using deep learning. Proceedings of the TENCON-IEEE Region 10 Conference, Jeju, Korea.10.1109/TENCON.2018.8650546 ↗
21. Abbas, W., and Khan, N.A. (2018, January 18–21). DeepMI: Deep learning for multiclass motor imagery classification. Proceedings of the 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Honolulu, HI, USA.10.1109/EMBC.2018.8512271 ↗
22. Learning temporal information for brain-computer interface using convolutional neural networks10.1109/TNNLS.2018.2789927 ↗
23. A multi-branch 3D convolutional neural network for EEG-based motor imagery classification10.1109/TNSRE.2019.2938295 ↗
24. Semi-supervised learning quantization algorithm with deep features for motor imagery EEG recognition in smart healthcare application10.1016/j.asoc.2020.106071 ↗
25. Advanced TSGL-EEGNet for Motor Imagery EEG-Based Brain-Computer Interfaces10.1109/ACCESS.2021.3056088 ↗
26. Zumray, D., and Olmez, T. (2021). Classification of Motor Imagery EEG Signals by Using a Divergence Based Convolutional Neural Network. arXiv.
27. Yu, T., and Zhu, H. (2020). Hyper-Parameter Optimization: A Review of Algorithms and Applications. arXiv.
28. Hyperparameter optimization for machine learning models based on Bayesian optimization
29. Improving brain E-health services via high-performance EEG classification with grouping Bayesian optimization10.1109/TSC.2019.2962673 ↗
30. Classification of multiple motor imagery using deep convolutional neural networks and spatial filters10.1016/j.asoc.2018.11.031 ↗
31. Cheng, D., Liu, Y., and Zhang, L. (2018, January 15–20). Exploring motor imagery EEG patterns for stroke patients with deep neural networks. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.10.1109/ICASSP.2018.8461525 ↗
32. Ioffe, S., and Szegedy, C. (2015). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. arXiv.
33. Lee, C.-Y., Gallagher, P.W., and Tu, Z. (2015). Generalizing Pooling Functions in Convolutional Neural Networks: Mixed, Gated, and Tree. arXiv.
34. Dropout: A simple way to prevent neural networks from overfitting
35. Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization
36. Bayesian methods in global optimization10.1007/BF00120661 ↗
37. Kramer, O., Ciaurri, D.E., and Koziel, S. (2011). Derivative-free optimization. Computational Optimization, Methods and Algorithms, Springer.10.1007/978-3-642-20859-1_4 ↗
38. Lutins, E. (2020, December 11). Ensemble Methods in Machine Learning: What Are They and Why Use Them?|by Evan Lutins|Towards Data Science. Available online: https://towardsdatascience.com/ensemble-methods-in-machine-learning-what-are-they-and-whyuse-them-68ec3f9fef5f.
39. Scikit-learn: Machine Learning in Python
40. Bisong, E. (2019). Building Machine Learning and Deep Learning Models on Google Cloud Platform, Springer.10.1007/978-1-4842-4470-8 ↗