journal article·2025-02-12Open access

ECA-ATCNet: Efficient EEG Decoding with Spike Integrated Transformer Conversion for BCI Applications

Xuhang Li, Qianzi Shen, Haitao Wang, Zijian Wang

Applied Sciences· Volume 15· Issue 4

Abstract

The Brain–Computer Interface (BCI) has applications in smart homes and healthcare by converting EEG signals into control commands. However, traditional EEG signal decoding methods are affected by individual differences, and although deep learning techniques have made significant breakthroughs, challenges such as high energy consumption and the processing of raw EEG data remain. This paper introduces the Efficient Channel Attention Temporal Convolutional Network (ECA-ATCNet) to enhance feature learning by applying Efficient Channel Attention Convolution (ECA-conv) across spatial and spectral dimensions. The model outperforms state-of-the-art methods in both within-subject and between-subject classification tasks on MI-EEG datasets (BCI-2a and PhysioNet), achieving accuracies of 87.89% and 71.88%, respectively. Additionally, the proposed Spike Integrated Transformer Conversion (SIT-conversion) method, based on Spiking–Softmax, converts the Transformer’s self-attention mechanism into Spiking Neural Networks (SNNs) in just 12 time steps. The accuracy loss of the converted ECA-ATCNet model is only 0.6% to 0.73%, while its energy consumption is reduced by 52.84% to 53.52%. SIT-conversion enables ultra-low-latency, near-lossless ANN-to-SNN conversion, with SNNs achieving similar accuracy to their ANN counterparts on image datasets. Inference energy consumption is reduced by 18.18% to 45.13%. This method offers a novel approach for low-power, portable BCI applications and contributes to the advancement of energy-efficient SNN algorithms.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: EEG and Brain-Computer Interfaces · Blind Source Separation Techniques · Neural dynamics and brain function

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science and Technology, Donghua University, Shanghai 201620, China

China Mobile Shanghai Industry Research Institute, Shanghai 201206, China

Funding

National Natural Science Foundation of China · Shanghai Sailing Program

References (77)

Show source-provided references
1. Physical Principles of Brain–Computer Interfaces and Their Applications for Rehabilitation, Robotics and Control of Human Brain States10.1016/j.physrep.2021.03.002 ↗
2. Flexible Brain–Computer Interfaces10.1038/s41928-022-00913-9 ↗
3. A Brain-Inspired Multi-Modal Perceptual System for Social Robots: An Experimental Realization10.1109/ACCESS.2018.2851841 ↗
4. Unimanual Versus Bimanual Motor Imagery Classifiers for Assistive and Rehabilitative Brain Computer Interfaces10.1109/TNSRE.2018.2877620 ↗
5. Single-Source to Single-Target Cross-Subject Motor Imagery Classification Based on Multisubdomain Adaptation Network10.1109/TNSRE.2022.3191869 ↗
6. Motor Imagery and Gait Control in Parkinson’s Disease: Techniques and New Perspectives in Neurorehabilitation10.1080/14737175.2022.2018301 ↗
7. Binks, J.A., Emerson, J.R., Scott, M.W., Wilson, C., Van Schaik, P., and Eaves, D.L. (2023). Enhancing Upper-Limb Neurorehabilitation in Chronic Stroke Survivors Using Combined Action Observation and Motor Imagery Therapy. Front. Neurol., 14.10.3389/fneur.2023.1097422 ↗
8. Optimization of an Independent Component Analysis Approach for Artifact Identification and Removal in Magnetoencephalographic Signals10.1016/j.clinph.2003.12.015 ↗
9. EEGLAB: An Open Source Toolbox for Analysis of Single-Trial EEG Dynamics Including Independent Component Analysis10.1016/j.jneumeth.2003.10.009 ↗
10. Removing Speech Artifacts from Electroencephalographic Recordings during Overt Picture Naming10.1016/j.neuroimage.2014.10.049 ↗
11. An Automatic Channel Selection Approach for ICA-Based Motor Imagery Brain Computer Interface10.1007/s10916-018-1106-3 ↗
12. Wavelet Transform Time-Frequency Image and Convolutional Network-Based Motor Imagery EEG Classification10.1109/ACCESS.2018.2889093 ↗
13. A CSP\AM-BA-SVM Approach for Motor Imagery BCI System10.1109/ACCESS.2018.2868178 ↗
14. A Sliding Window Common Spatial Pattern for Enhancing Motor Imagery Classification in EEG-BCI10.1109/TIM.2021.3051996 ↗
15. Motor Imagery EEG Recognition Based on Conditional Optimization Empirical Mode Decomposition and Multi-Scale Convolutional Neural Network10.1016/j.eswa.2020.113285 ↗
16. Chatterjee, R., and Bandyopadhyay, T. (2016, January 11). EEG Based Motor Imagery Classification Using SVM and MLP. Proceedings of the 2016 2nd International Conference on Computational Intelligence and Networks (CINE), Bhubaneswar, India.10.1109/CINE.2016.22 ↗
17. Towards Efficient Decoding of Multiple Classes of Motor Imagery Limb Movements Based on EEG Spectral and Time Domain Descriptors10.1007/s10916-017-0843-z ↗
18. Dai, M., Zheng, D., Na, R., Wang, S., and Zhang, S. (2019). EEG Classification of Motor Imagery Using a Novel Deep Learning Framework. Sensors, 19.10.3390/s19030551 ↗
19. A Novel Approach of Decoding EEG Four-Class Motor Imagery Tasks via Scout ESI and CNN10.1088/1741-2552/ab4af6 ↗
20. A Multi-Scale Fusion Convolutional Neural Network Based on Attention Mechanism for the Visualization Analysis of EEG Signals Decoding10.1109/TNSRE.2020.3037326 ↗
21. Zancanaro, A., Cisotto, G., Paulo, J.R., Pires, G., and Nunes, U.J. (2021, January 13). CNN-Based Approaches For Cross-Subject Classification in Motor Imagery: From the State-of-The-Art to DynamicNet. Proceedings of the 2021 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB), Melbourne, Australia.10.1109/CIBCB49929.2021.9562821 ↗
22. Altuwaijri, G.A., Muhammad, G., Altaheri, H., and Alsulaiman, M. (2022). A Multi-Branch Convolutional Neural Network with Squeeze-and-Excitation Attention Blocks for EEG-Based Motor Imagery Signals Classification. Diagnostics, 12.10.3390/diagnostics12040995 ↗
23. Motor Imagery Classification via Temporal Attention Cues of Graph Embedded EEG Signals10.1109/JBHI.2020.2967128 ↗
24. Amin, S.U., Altaheri, H., Muhammad, G., Alsulaiman, M., and Abdul, W. (2021, January 17). Attention Based Inception Model for Robust EEG Motor Imagery Classification. Proceedings of the 2021 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), Glasgow, UK.10.1109/I2MTC50364.2021.9460090 ↗
25. Attention-Inception and Long- Short-Term Memory-Based Electroencephalography Classification for Motor Imagery Tasks in Rehabilitation10.1109/TII.2021.3132340 ↗
26. Bai, S., Kolter, J.Z., and Koltun, V. (2018). An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling 2018. arXiv.
27. Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural Machine Translation by Jointly Learning to Align and Translate 2016. arXiv.
28. Luong, T., Pham, H., and Manning, C.D. (2015, January 17–21). Effective Approaches to Attention-Based Neural Machine Translation. Proceedings of the Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing; Association for Computational Linguistics, Lisbon, Portugal.10.18653/v1/D15-1166 ↗
29. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017). Attention Is All You Need. Advances in Neural Information Processing Systems, Curran Associates, Inc.
30. A Transformer-Based Approach Combining Deep Learning Network and Spatial-Temporal Information for Raw EEG Classification10.1109/TNSRE.2022.3194600 ↗
31. Altuwaijri, G.A., and Muhammad, G. (2022). Electroencephalogram-Based Motor Imagery Signals Classification Using a Multi-Branch Convolutional Neural Network Model with Attention Blocks. Bioengineering, 9.10.3390/bioengineering9070323 ↗
32. Physics-Informed Attention Temporal Convolutional Network for EEG-Based Motor Imagery Classification10.1109/TII.2022.3197419 ↗
33. Huang, Y., Zheng, J., Xu, B., Li, X., Liu, Y., Wang, Z., Feng, H., and Cao, S. (2023). An Improved Model Using Convolutional Sliding Window-Attention Network for Motor Imagery EEG Classification. Front. Neurosci., 17.10.3389/fnins.2023.1204385 ↗
34. Dynamic Convolution With Multilevel Attention for EEG-Based Motor Imagery Decoding10.1109/JIOT.2023.3281911 ↗
35. Networks of Spiking Neurons: The Third Generation of Neural Network Models10.1016/S0893-6080(97)00011-7 ↗
36. Towards Spike-Based Machine Intelligence with Neuromorphic Computing10.1038/s41586-019-1677-2 ↗
37. Deep Residual Learning in Spiking Neural Networks
38. Spiking Deep Residual Networks10.1109/TNNLS.2021.3119238 ↗
39. Going Deeper With Directly-Trained Larger Spiking Neural Networks10.1609/aaai.v35i12.17320 ↗
40. Lotfi Rezaabad, A., and Vishwanath, S. (2020, January 28). Long Short-Term Memory Spiking Networks and Their Applications. Proceedings of the International Conference on Neuromorphic Systems 2020, Oak Ridge, TN, USA.10.1145/3407197.3407211 ↗
41. Mueller, E., Studenyak, V., Auge, D., and Knoll, A. (2021, January 13). Spiking Transformer Networks: A Rate Coded Approach for Processing Sequential Data. Proceedings of the 2021 7th International Conference on Systems and Informatics (ICSAI), Chongqing, China.10.1109/ICSAI53574.2021.9664146 ↗
42. Wang, Z., Fang, Y., Cao, J., Zhang, Q., Wang, Z., and Xu, R. (2022). Masked Spiking Transformer. arXiv.10.1109/ICCV51070.2023.00169 ↗
43. Ho, N.-D., and Chang, I.-J. (2021, January 5). TCL: An ANN-to-SNN Conversion with Trainable Clipping Layers. Proceedings of the 2021 58th ACM/IEEE Design Automation Conference (DAC), San Francisco, CA, USA.10.1109/DAC18074.2021.9586266 ↗
44. Jiang, H., Anumasa, S., Masi, G.D., Xiong, H., and Gu, B. (2023). A Unified Optimization Framework of ANN-SNN Conversion: Towards Optimal Mapping from Activation Values to Firing Rates. International Conference on Machine Learning, PMLR.
45. Spiking Neural Networks Trained with Particle Swarm Optimization for Motor Imagery Classification10.1007/978-3-319-41009-8_26 ↗
46. Spiking Neural Networks Applied to the Classification of Motor Tasks in EEG Signals10.1016/j.neunet.2019.09.037 ↗
47. Kumar, N., Tang, G., Yoo, R., and Michmizos, K.P. (2022). Decoding EEG With Spiking Neural Networks on Neuromorphic Hardware. Trans. Mach. Learn. Res.
48. A Convolutional Spiking Neural Network with Adaptive Coding for Motor Imagery Classification10.1016/j.neucom.2023.126470 ↗
49. HR-SNN: An End-to-End Spiking Neural Network for Four-Class Classification Motor Imagery Brain–Computer Interface10.1109/TCDS.2024.3395443 ↗
50. EEGNet: A Compact Convolutional Neural Network for EEG-Based Brain–Computer Interfaces10.1088/1741-2552/aace8c ↗
51. Transformer-Based Spiking Neural Networks for Multimodal Audio-Visual Classification10.1109/TCDS.2023.3327081 ↗
52. Optimized Spiking Neurons Can Classify Images with High Accuracy through Temporal Coding with Two Spikes10.1038/s42256-021-00311-4 ↗
53. Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., and Hu, Q. (2020, January 13–19). ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01155 ↗
54. Deep Learning with Convolutional Neural Networks for EEG Decoding and Visualization10.1002/hbm.23730 ↗
55. Ba, J.L., Kiros, J.R., and Hinton, G.E. (2016). Layer Normalization. arXiv.
56. Ingolfsson, T.M., Hersche, M., Wang, X., Kobayashi, N., Cavigelli, L., and Benini, L. (2020, January 11). EEG-TCNet: An Accurate Temporal Convolutional Network for Embedded Motor-Imagery Brain–Machine Interfaces. Proceedings of the 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Toronto, ON, Canada.10.1109/SMC42975.2020.9283028 ↗
57. Zhang, J., and Zhang, L. (2023, January 17). Spiking Neural Network Implementation on FPGA for Multiclass Classification. Proceedings of the 2023 IEEE International Systems Conference (SysCon), Vancouver, BC, Canada.10.1109/SysCon53073.2023.10131076 ↗
58. Brunner, C., Leeb, R., Muller-Putz, G.R., and Schlogl, A. (2025, January 20). BCI Competition 2008—Graz Data Set A. Available online: https://lampx.tugraz.at/~bci/database/001-2014/description.pdf.
59. BCI2000: A General-Purpose Brain-Computer Interface (BCI) System10.1109/TBME.2004.827072 ↗
60. Singh, A., Lal, S., and Guesgen, H.W. (2019). Reduce Calibration Time in Motor Imagery Using Spatially Regularized Symmetric Positives-Definite Matrices Based Classification. Sensors, 19.10.3390/s19020379 ↗
61. A Coefficient of Agreement for Nominal Scales10.1177/001316446002000104 ↗
62. Ali, O., Saif-ur-Rehman, M., Glasmachers, T., Iossifidis, I., and Klaes, C. (2024). ConTraNet: A Hybrid Network for Improving the Classification of EEG and EMG Signals with Limited Training Data. Comput. Biol. Med., 168.10.1016/j.compbiomed.2023.107649 ↗
63. DIET-SNN: A Low-Latency Spiking Neural Network With D Irect I Nput E Ncoding and Leakage and T Hreshold Optimization10.1109/TNNLS.2021.3111897 ↗
64. Horowitz, M. (2014, January 9–13). 1.1 Computing’s Energy Problem (and What We Can Do about It). In Proceedings of the 2014 IEEE International Solid-State Circuits Conference Digest of Technical Papers (ISSCC). San Francisco, CA, USA.10.1109/ISSCC.2014.6757323 ↗
65. Liao, X., Li, G., Wang, Y., Sun, L., and Zhang, H. (2025). Constructing Lightweight and Efficient Spiking Neural Networks for EEG-Based Motor Imagery Classification. Biomed. Signal Process. Control, 100.10.1016/j.bspc.2024.107000 ↗
66. EdgeNeXt: Efficiently Amalgamated CNN-Transformer Architecture for Mobile Vision Applications
67. Li, J., Xia, X., Li, W., Li, H., Wang, X., Xiao, X., Wang, R., Zheng, M., and Pan, X. (2022). Next-ViT: Next Generation Vision Transformer for Efficient Deployment in Realistic Industrial Scenarios. arXiv.
68. UniFormer: Unifying Convolution and Self-Attention for Visual Recognition10.1109/TPAMI.2023.3282631 ↗
69. Gradient-Based Learning Applied to Document Recognition10.1109/5.726791 ↗
70. Krizhevsky, A. (2024, December 26). Learning Multiple Layers of Features from Tiny Images. Available online: https://www.cs.toronto.edu/~kriz/learning-features-2009-TR.pdf.
71. Deng, J., Dong, W., Socher, R., Li, L.-J., Kai, L., and Li, F.-F. (2009, January 20–25). ImageNet: A Large-Scale Hierarchical Image Database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
72. Loshchilov, I., and Hutter, F. (2017). Decoupled Weight Decay Regularization. arXiv.
73. Wang, Y., Zhang, M., Chen, Y., and Qu, H. (2022, January 23–29). Signed Neuron with Memory: Towards Simple, Accurate and High-Efficient ANN-SNN Conversion. Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence; International Joint Conferences on Artificial Intelligence Organization, Vienna, Austria.10.24963/ijcai.2022/347 ↗
74. Bu, T., Fang, W., Ding, J., Dai, P., Yu, Z., and Huang, T. (2023). Optimal ANN-SNN Conversion for High-Accuracy and Ultra-Low-Latency Spiking Neural Networks. arXiv.
75. Zhou, Z., Zhu, Y., He, C., Wang, Y., Yan, S., Tian, Y., and Yuan, L. (2022). Spikformer: When Spiking Neural Network Meets Transformer. arXiv.
76. Zhou, C., Yu, L., Zhou, Z., Ma, Z., Zhang, H., Zhou, H., and Tian, Y. (2023). Spikingformer: Spike-Driven Residual Learning for Transformer-Based Spiking Neural Network. arXiv.
77. Zhou, Z., Che, K., Fang, W., Tian, K., Zhu, Y., Yan, S., Tian, Y., and Yuan, L. (2024). Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticket. arXiv.