journal article·2024-04-19Open access

Comparing Several P300-Based Visuo-Auditory Brain-Computer Interfaces for a Completely Locked-in ALS Patient: A Longitudinal Case Study

Rute Bettencourt, Miguel Castelo-Branco, Edna Gonçalves, Urbano J. Nunes, Gabriel Pires

Applied Sciences· Volume 14· Issue 8

Abstract

In a completely locked-in state (CLIS), often resulting from traumatic brain injury or neurodegenerative diseases like amyotrophic lateral sclerosis (ALS), patients lose voluntary muscle control, including eye movement, making communication impossible. Brain-computer interfaces (BCIs) offer hope for restoring communication, but achieving reliable communication with these patients remains a challenge. This study details the design, testing, and comparison of nine visuo-auditory P300-based BCIs (combining different visual and auditory stimuli and different visual layouts) with a CLIS patient over ten months. The aim was to evaluate the impact of these stimuli in achieving effective communication. While some interfaces showed promising progress, achieving up to 90% online accuracy in one session, replicating this success in subsequent sessions proved challenging, with the average online accuracy across all sessions being 56.4 ± 15.2%. The intertrial variability in EEG signals and the low discrimination between target and non-target events were the main challenge. Moreover, the lack of communication with the patient made BCI design a challenging blind trial-and-error process. Despite the inconsistency of the results, it was possible to infer that the combination of visual and auditory stimuli had a positive impact, and that there was an improvement over time.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: EEG and Brain-Computer Interfaces · Neuroscience and Neural Engineering · Neural dynamics and brain function

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of Systems and Robotics, University of Coimbra, 3030-290 Coimbra, Portugal

Coimbra Institute for Biomedical Imaging and Translational Research, University of Coimbra, 3000-548 Coimbra, Portugal

Faculty of Medicine, University of Coimbra, 3000-370 Coimbra, Portugal

University Hospital Center of São João, 4200-319 Porto, Portugal

Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal

Department of Electrical and Computer Engineering, Faculty of Sciences and Technology, University of Coimbra, 3030-290 Coimbra, Portugal

Department of Engineering, School of Technology of Tomar, Polytechnic Institute of Tomar, 2300-313 Tomar, Portugal

Funding

the Portuguese Foundation for Science and Technology (FCT) · B-RELIABLE · the FCT Ph.D. scholarship

References (34)

Show source-provided references
1. Breaking the Silence: Brain–Computer Interfaces (BCI) for Communication and Motor Control10.1111/j.1469-8986.2006.00456.x ↗
2. Varieties of the Locked-in Syndrome10.1007/BF00313105 ↗
3. Locked-in Syndrome Revisited10.1177/17562864231160873 ↗
4. An Observational Study on Quality of Life and Preferences to Sustain Life in Locked-in State
5. Usability of Eyetracking Computer Systems and Impact on Psychological Wellbeing in Patients with Advanced Amyotrophic Lateral Sclerosis10.1080/21678421.2017.1392576 ↗
6. Long-Term Use of a Neural Prosthesis in Progressive Paralysis10.1038/s41598-018-35211-y ↗
7. Visuo-Auditory Stimuli with Semantic, Temporal and Spatial Congruence for a P300-Based BCI: An Exploratory Test with an ALS Patient in a Completely Locked-in State10.1016/j.jneumeth.2022.109661 ↗
8. Complete Locked-in and Locked-in Patients: Command Following Assessment and Communication with Vibro-Tactile P300 and Motor Imagery Brain-Computer Interface Tools10.3389/fnins.2017.00251 ↗
9. Electroencephalography-Based Endogenous Brain-Computer Interface for Online Communication with a Completely Locked-in Patient10.1186/s12984-019-0493-0 ↗
10. A Communication Means for Totally Locked-in ALS Patients Based on Changes in Cerebral Blood Volume Measured with Near-Infrared Light10.1093/ietisy/e90-d.7.1028 ↗
11. Semantic and BCI-Performance in Completely Paralyzed Patients: Possibility of Language Attrition in Completely Locked in Syndrome10.1016/j.bandl.2019.05.004 ↗
12. Spelling Interface Using Intracortical Signals in a Completely Locked-in Patient Enabled via Auditory Neurofeedback Training10.1038/s41467-022-28859-8 ↗
13. Rezvani, S., Hosseini-Zahraei, S.H., Tootchi, A., Guger, C., Chaibakhsh, Y., Saberi, A., and Chaibakhsh, A. (2023). A Review on the Performance of Brain-Computer Interface Systems Used for Patients with Locked-in and Completely Locked-in Syndrome. Cogn. Neurodyn., 1–25.10.1007/s11571-023-09995-3 ↗
14. A Brain–Computer Interface Controlled Auditory Event-Related Potential (P300) Spelling System for Locked-In Patients10.1111/j.1749-6632.2008.04122.x ↗
15. Brain–Computer Interfaces and Communication in Paralysis: Extinction of Goal Directed Thinking in Completely Paralysed Patients?10.1016/j.clinph.2008.06.019 ↗
16. Transition from the Locked in to the Completely Locked-in State: A Physiological Analysis10.1016/j.clinph.2010.08.019 ↗
17. Independent Home Use of a Brain-Computer Interface by People with Amyotrophic Lateral Sclerosis10.1212/WNL.0000000000005812 ↗
18. The Psychophysics Toolbox10.1163/156856897X00357 ↗
19. The VideoToolbox Software for Visual Psychophysics: Transforming Numbers into Movies10.1163/156856897X00366 ↗
20. Presentation and validation of the Radboud faces database10.1080/02699930903485076 ↗
21. Flashing Characters with Famous Faces Improves ERP-Based Brain-Computer Interface Performance10.1088/1741-2560/8/5/056016 ↗
22. Face Stimuli Effectively Prevent Brain–Computer Interface Inefficiency in Patients with Neurodegenerative Disease10.1016/j.clinph.2012.11.006 ↗
23. A Novel BCI Based on ERP Components Sensitive to Configural Processing of Human Faces10.1088/1741-2560/9/2/026018 ↗
24. Toward a Reliable Gaze-Independent Hybrid BCI Combining Visual and Natural Auditory Stimuli10.1016/j.jneumeth.2015.11.026 ↗
25. Statistical Spatial Filtering for a P300-Based BCI: Tests in Able-Bodied, and Patients with Cerebral Palsy and Amyotrophic Lateral Sclerosis10.1016/j.jneumeth.2010.11.016 ↗
26. EEGLAB: An Open Source Toolbox for Analysis of Single-Trial EEG Dynamics Including Independent Component Analysis10.1016/j.jneumeth.2003.10.009 ↗
27. Brain Signals of Face Processing as Revealed by Event-Related Potentials10.1155/2015/514361 ↗
28. Spatial Filtering Based on Riemannian Distance to Improve the Generalization of ErrP Classification10.1016/j.neucom.2021.10.078 ↗
29. Neurophysiological Aspects of the Completely Locked-in Syndrome in Patients with Advanced Amyotrophic Lateral Sclerosis10.1016/j.clinph.2021.01.013 ↗
30. Assessing Attention and Cognitive Function in Completely Locked-in State with Event-Related Brain Potentials and Epidural Electrocorticography10.1088/1741-2560/11/2/026006 ↗
31. Electroencephalography of Completely Locked-in State Patients with Amyotrophic Lateral Sclerosis10.1016/j.neures.2020.01.013 ↗
32. EEG Power Spectral Density in Locked-in and Completely Locked-in State Patients: A Longitudinal Study10.1007/s11571-020-09639-w ↗
33. Online Control of an Assistive Active Glove by Slow Cortical Signals in Patients with Amyotrophic Lateral Sclerosis10.1088/1741-2552/ac0488 ↗
34. Participant-Specific Classifier Tuning Increases the Performance of Hand Movement Detection from EEG in Patients with Amyotrophic Lateral Sclerosis10.1088/1741-2552/ac15e3 ↗