journal article·2025-11-27Open access

Multi-Modal EEG–Fusion Neurointerface Wheelchair Control System

Rongrong An, Yijie Zhou, Hongwei Chen, Xin Xu

Applied Sciences· Volume 15· Issue 23

Abstract

The development of effective and user-friendly brain–computer interface (BCI) systems is essential for enhancing mobility and autonomy among individuals with physical disabilities. Recent studies have demonstrated significant advances in BCI technologies, particularly in the areas of motor imagery (MI), blink detection, and attention-level analysis. However, existing systems often face limitations, such as low classification accuracy, high latency, and poor robustness in dynamic, real-world environments. Furthermore, most traditional BCIs rely on single-modality approaches, which restrict their adaptability and real-time performance. This paper aims to address these challenges by presenting a multi-modal Electroencephalography (EEG)–fusion neurointerface wheelchair system integrating MI, intentional blink detection, and attention-level analysis. The proposed system improves on previous methods by employing a novel eight-channel needle-shaped dry electrode EEG headset, which significantly enhances signal quality through better electrode–skin contact without the need for conductive gels. Additionally, the system processes EEG signals in real-time using a Jetson Nano platform, incorporating a dual-threshold blink detection algorithm for emergency stops, an optimized random forest classifier for decoding directional MI, and a support vector machine (SVM) for attention-level assessment. Experimental evaluations involving classification accuracy, response latency, and trajectory-following precision confirmed robust system performance. MI classification accuracy averaged around 80%, with optimized attention-level analysis reaching up to 94.1%. Trajectory control tests demonstrated minimal deviation from predefined paths (typically less than 0.25 m). These results highlight the system’s advancements over existing single-modality BCIs, showcasing its potential to significantly improve the quality of life for mobility-impaired users. Future studies should focus on enhancing lateral MI detection accuracy, expanding datasets, and validating system robustness across diverse real-world scenarios.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: EEG and Brain-Computer Interfaces · Gaze Tracking and Assistive Technology · Spinal Cord Injury Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Communication and Information Engineering, Nanjing University of Posts and Telecommunications, No. 66, XinMofan Road, Gulou District, Nanjing 210003, China

Portland College, Nanjing University of Posts and Telecommunications, 9 Wenyuan Road, Yadong New District, Nanjing 210023, China

References (32)

Show source-provided references
1. Palumbo, A., Gramigna, V., Calabrese, B., and Ielpo, N. (2021). Motor-Imagery EEG-Based BCIs in Wheelchair Movement and Control: A Systematic Literature Review. Sensors, 21.10.36227/techrxiv.14916537 ↗
2. A Review of Disability EEG-Based Wheelchair Control Systems: Taxonomy, Challenges and Recommendations10.1016/j.cmpb.2018.06.012 ↗
3. Siribunyaphat, N., and Punsawad, Y. (2023). Brain–Computer Interface Based on Steady-State Visual Evoked Potential Using Quick-Response Code Pattern for Wheelchair Control. Sensors, 23.10.3390/s23042069 ↗
4. Multimodal Brain-Controlled System for Rehabilitation Training: Combining Asynchronous Online Brain–Computer Interface and Exoskeleton10.1016/j.jneumeth.2024.110132 ↗
5. Ghasemi, S., Gračanin, D., and Azab, M. (2024). Empowering Mobility: Brain–Computer Interface for Enhancing Wheelchair Control for Individuals with Physical Disabilities. arXiv.10.1007/978-3-031-60884-1_16 ↗
6. Rashid, M., Sulaiman, N., Majeed, A.P.P.A., Musa, R.M., Nasir, A.F.A., Bari, B.S., and Khatun, S. (2020). Current Status, Challenges, and Possible Solutions of EEG-Based Brain-Computer Interface: A Comprehensive Review. Front. Neurorobot., 14.10.3389/fnbot.2020.00025 ↗
7. American Clinical Neurophysiology Society Guideline 4: Recording Clinical EEG on Digital Media10.1080/21646821.2016.1245563 ↗
8. NVIDIA Corporation (2025, October 26). NVIDIA Jetson Nano Developer Kit: Technical Specifications. Available online: https://developer.nvidia.com/embedded/jetson-nano.
9. Canilang, H.M., Caliwag, E.M.F., Njoku, J., Caliwag, A., and Lim, W. (2025, October 10). Edge EEG: Edge AI Device-based EEG Signal Processing for Emotion Recognition. Available online: https://api.semanticscholar.org/CorpusID:244950821.
10. An Information-Maximization Approach to Blind Separation and Blind Deconvolution10.1162/neco.1995.7.6.1129 ↗
11. Deep learning in motor imagery EEG signal decoding: A Systematic Review10.1016/j.neucom.2024.128577 ↗
12. Liao, W., Liu, H., and Wang, W. (2025). Advancing BCI with a transformer-based model for motor imagery classification. Sci. Rep., 15.10.1038/s41598-025-06364-4 ↗
13. An, Y., Mitchell, D., Lathrop, J., Flynn, D., and Chung, S.-J. (2024). Motor Imagery Teleoperation of a Mobile Robot Using a Low-Cost Brain–Computer Interface for Multi-Day Validation. arXiv.10.1109/Telepresence63209.2024.10841769 ↗
14. A Review on electroencephalogram Based Channel Selection
15. What Is a Blink? Classifying and Characterizing Blinks in Eye Openness Signals10.3758/s13428-023-02333-9 ↗
16. Human Brain Control of Electric Wheelchair with Eye-Blink Electrooculogram Signal
17. Wang, M., Cui, X., Wang, T., Jiang, T., Gao, F., and Cao, J. (2023). Eye blink artifact detection based on multi-dimensional EEG feature fusion and optimization. Biomed. Signal Process. Control, 83.10.1016/j.bspc.2023.104657 ↗
18. Robust detrending, rereferencing, outlier detection, and inpainting for multichannel data10.1016/j.neuroimage.2018.01.035 ↗
19. Removing electroencephalographic artifacts by blind source separation10.1111/1469-8986.3720163 ↗
20. Random Forests10.1023/A:1010933404324 ↗
21. Kaushik, P., Moye, A., van Vugt, M., and Roy, P.P. (2022). Decoding the cognitive states of attention and distraction in a real-life setting using EEG. Sci. Rep., 12.10.1038/s41598-022-24417-w ↗
22. Schölkopf, B., and Smola, A.J. (2002). Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond, MIT Press.10.7551/mitpress/4175.001.0001 ↗
23. Hsu, C.W., Chang, C.C., and Lin, C.J. (2010). A Practical Guide to Support Vector Classification, Department of Computer Science, National Taiwan University. Available online: https://www.csie.ntu.edu.tw/~cjlin/papers/guide/guide.pdf.
24. Brain-Computer Interfaces for Communication and Control10.1016/S1388-2457(02)00057-3 ↗
25. A review of classification algorithms for EEG-based brain-computer interfaces10.1088/1741-2560/4/2/R01 ↗
26. Controlling a Wheelchair Indoors Using Thought10.1109/MIS.2007.26 ↗
27. A Noninvasive Brain-Actuated Wheelchair Based on a P300 Neurophysiological Protocol and Automated Navigation10.1109/TRO.2009.2020347 ↗
28. Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans10.1073/pnas.0403504101 ↗
29. Impedance and Noise of Passive and Active Dry EEG Electrodes: A Review10.1109/JSEN.2020.3012394 ↗
30. Event-related EEG/MEG synchronization and desynchronization: Basic principles10.1016/S1388-2457(99)00141-8 ↗
31. Wearable EEG and beyond10.1007/s13534-018-00093-6 ↗
32. Sayel, N.A., Sabbar, B.M., and Albermany, S. (2022, January 21–22). Real Time Control System for Wheel Chair of Disabled People Using EEG Signal. Proceedings of the 2022 4th International Conference on Advanced Science and Engineering (ICOASE), Zakho, Iraq.10.1109/ICOASE56293.2022.10075575 ↗