Enhancing P300-Based Brain-Computer Interfaces with Hybrid Transfer Learning: A Data Alignment and Fine-Tuning Approach
Source abstract
Abstract
A new approach is introduced to address the subject dependency problem in P300-based brain-computer interfaces (BCI) by using transfer learning. The occurrence of P300, an event-related potential, is primarily associated with changes in natural neuron activity and elicited in response to infrequent stimuli, which can be monitored non-invasively through an electroencephalogram. However, implementing P300-based BCI in real-time requires many training samples and time-consuming calibration, making it challenging to use in practical applications. To tackle these challenges, the proposed approach harnesses the high-level feature extraction capability of a deep neural network, achieved through fine-tuning. To ensure similar distributions of feature extraction data, the approach of aligning data in Euclidean space is employed, which is then applied to a discriminatively restricted Boltzmann machine with a single layer for P300 detection. The performance of the proposed method on the BCI Competition III dataset II and the BCI competition II dataset II, the state-of-the-art dataset, was evaluated and compared with previous studies. The results showed that robust performance could be achieved using a small number of training samples, demonstrating the effectiveness of the transfer learning approach in P300-based BCI applications.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: EEG and Brain-Computer Interfaces · Neuroscience and Neural Engineering · Neural dynamics and brain function
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical Engineering, Iran University of Science and Technology (IUST), Tehran 13114-16846, Iran
Department of Computer Engineering, Gheorghe Asachi Technical University of Iasi, 700050 Iasi, Romania
Funding
COST Action 19111 NEWFOCUS
References (42)
Show source-provided references
1. Brain computer interface: Control signals review10.1016/j.neucom.2016.10.024 ↗
2. Paszkiel, S., and Pawu, D. (2022). BCI Wheelchair Control Using Expert System Classifying EEG Signals Based on Power Spectrum Estimation and Nervous Tics Detection. Appl. Sci., 12.10.3390/app122010385 ↗
3. Brain computer interfaces, a review10.3390/s120201211 ↗
4. Kamhi, S., Zhang, S., Amou, M.A., Mouhafid, M., Javaid, I., Ahmad, I.S., El Kader, I.A., and Kulsum, U. (2022). Multi-Classification of Motor Imagery EEG Signals Using Bayesian Optimization-Based Average Ensemble Approach. Appl. Sci., 12.10.3390/app12125807 ↗
5. Dinteren, R., Arns, M., Jongsma, M.L.A., and Kessels, R.P.C. (2014). P300 development across the lifespan: A systematic review and meta-analysis. PLoS ONE, 9.10.1371/journal.pone.0087347 ↗
6. Gannouni, S., Belwafi, K., Alangari, N., AboAlsamh, H., and Belghith, A. (2022). Classification Strategies for P300-Based BCI-Spellers Adopting the Row Column Paradigm. Sensors, 22.10.3390/s22239159 ↗
7. Taejun, L., Kim, M., and Kim, S.P. (2020). Improvement of P300-based brain-computer interfaces for home appliances control by data balancing techniques. Sensors, 20.10.3390/s20195576 ↗
8. The evaluation of Hashimoto’s thyroiditis with event related potentials and magnetic resonance spectroscopy and its relation to cognitive function10.1038/s41598-021-82281-6 ↗
9. The relationship between event-related potentials, stress perception and personality type in patients with multiple sclerosis without cognitive impairment: A pilot study10.17219/acem/68944 ↗
10. Affective Stimuli for an Auditory P300 Brain-Computer Interface10.3389/fnins.2017.00522 ↗
11. High-speed spelling with a noninvasive brain-computer interface10.1073/pnas.1508080112 ↗
12. A comprehensive review of EEG-based brain-computer interface paradigms10.1088/1741-2552/aaf12e ↗
13. A review of classification algorithms for EEG-based brain-computer interfaces: A 10 year update10.1088/1741-2552/aab2f2 ↗
14. A review on transfer learning in EEG signal analysis10.1016/j.neucom.2020.09.017 ↗
15. Transfer Learning for EEG-Based Brain-Computer Interfaces: A Review of Progress Made Since 201610.1109/TCDS.2020.3007453 ↗
16. A Survey on Transfer Learning10.1007/978-981-15-5971-6_83 ↗
17. Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., and Liu, C. (2018, January 4–7). A Survey on Deep Transfer Learning Chuanqi. Proceedings of the 27th International Conference on Artificial Neural Networks, Rhodes, Greece.10.1007/978-3-030-01424-7_27 ↗
18. Ganin YLempitsky, V. (2015, January 6–11). Unsupervised Domain Adaptation by Backpropagation. Proceedings of the 32nd International Conference on Machine Learning, Lille, France.
19. A Deep Transfer Convolutional Neural Network Framework for EEG Signal Classification10.1109/ACCESS.2019.2930958 ↗
20. P300 based character recognition using convolutional neural network and support vector machine10.1016/j.bspc.2019.101645 ↗
21. Wang, Y.X., Ramanan, D., and Hebert, M. (2017, January 21–26). Growing a brain: Fine-tuning by increasing model capacity. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017), Honolulu, HI, USA.10.1109/CVPR.2017.323 ↗
22. Fine-tuning Convolutional Neural Networks for Fine Art Classification10.1016/j.eswa.2018.07.026 ↗
23. Transfer learning: A Riemannian geometry framework with applications to Brain-Computer Interfaces10.1109/TBME.2017.2742541 ↗
24. Transfer Learning for Brain-Computer Interfaces: A Euclidean Space Data Alignment Approach10.1109/TBME.2019.2913914 ↗
25. Kilani, S., Kordmahale, S.N.A., Ghassemlooy, Z., Hulea, M., and Wu, Q. (2022, January 20–22). Reducing calibration time using novel hybrid transfer-learning for P300-based BCI applications. Proceedings of the 13th International Symposium on Communication Systems, Networks and Digital Signal Processing (CSNDSP), Porto, Portugal.10.1109/CSNDSP54353.2022.9908000 ↗
26. Rezeika, A., Benda, M., Stawicki, P., Gembler, F., Saboor, A., and Volosyak, I. (2018). Brain-computer interface spellers: A review. Brain Sci., 8.10.3390/brainsci8040057 ↗
27. Blankertz, O.B. (2002). Documentation Wadsworth BCI Dataset (P300 Evoked Potentials). BCI Classif. Contest, 1–9. Available online: https://www.bbci.de/competition/ii/albany_desc/albany_desc_ii.pdf.
28. EEGNet: A compact convolutional neural network for EEG-based brain-computer interfaces10.1088/1741-2552/aace8c ↗
29. Neurocomputing Deep learning based on Batch Normalization for P300 signal detection10.1016/j.neucom.2017.08.039 ↗
30. How transferable are features in deep neural networks?
31. A spatial-temporal linear feature learning algorithm for P300-based brain-computer interfaces10.1016/j.heliyon.2023.e15380 ↗
32. Spatial-Temporal Discriminative Restricted Boltzmann Machine for Event-related Potential Detection and Analysis10.1109/TNSRE.2019.2892960 ↗
33. Multiobjective evolutionary algorithms to identify highly autocorrelated areas: The case of spatial distribution in financially compromised farms10.1007/s10479-011-0841-3 ↗
34. Convolutional neural networks for P300 detection with application to brain-computer interfaces10.1109/TPAMI.2010.125 ↗
35. BCI competition III: Dataset II-ensemble of SVMs for BCI P300 speller10.1109/TBME.2008.915728 ↗
36. Varsamou, M., and Antonakopoulos, T. (2019, January 19–21). Classification using discriminative restricted boltzmann machines on spark. Proceedings of the 2019 International Conference on Software, Telecommunications and Computer Networks, SoftCOM 2019, Split, Croatia.10.23919/SOFTCOM.2019.8903859 ↗
37. BCI competition 2003—Data set IIb: Support vector machines for the P300 speller paradigm10.1109/TBME.2004.826698 ↗
38. Grouped Automatic Relevance Determination and Its Application in Channel Selection for P300 BCIs10.1109/TNSRE.2015.2413943 ↗
39. Mussabayeva, A., Jamwal, P.K., and Akhtar, M.T. (2021). Ensemble Voting-Based Multichannel EEG Classification in a Subject-Independent P300 Speller. Appl. Sci., 11.10.3390/app112311252 ↗
40. Velasco-Álvarez, F., Fernández-Rodríguez, Á., Vizcaíno-Martín, F.-J., Díaz-Estrella, A., and RRon-Angevin, R. (2021). Brain-computer interface (BCI) control of a virtual assistant in a smartphone to manage messaging applications. Sensors, 21.10.3390/s21113716 ↗
41. Mezzina, G., Annese, V.F., and De Venuto, D. (2021). A Cybersecure P300-Based Brain-to-Computer Interface against Noise-Based and Fake P300 Cyberattacks. Sensors, 21.10.3390/s21248280 ↗
42. Li, M., Li, F., Pan, J., Zhang, D., Zhao, S., Li, J., and Wang, F. (2021). The MindGomoku: An Online P300 BCI Game Based on Bayesian Deep Learning. Sensors, 21.10.3390/s21051613 ↗