journal article·2025-12-18Open access

Self-Supervised Representation Learning for EEG-Based Detection of Neurodegenerative Diseases

Federico Del Pup, Louis Fabrice Tshimanga, Andrea Zanola, Luca Taffarello, Elisa Tentori, Manfredo Atzori

Applied Sciences· Volume 15· Issue 24

Abstract

Electroencephalography (EEG) is an important noninvasive diagnostic tool for detecting neurodegenerative disorders. In this context, EEG-based deep learning models show promise due to their ability to capture nonlinear brain dynamics but often suffer from poor generalizability caused by high inter-subject variability. Self-supervised learning (SSL) offers a promising solution by enabling models to learn robust representations from large unlabeled datasets. This study introduces a double-masking representation learning framework for EEG analysis. Using data aggregated from eight multi-center datasets (3156 subjects; 439 h of EEG recordings), a hybrid convolutional-transformer model (TransformEEG) is pretrained to enhance generalization in neurodegenerative disease classification, focusing on Parkinson’s and Alzheimer’s diseases. This approach combines phase-swap data augmentation, designed to facilitate the learning of EEG phase-amplitude coupling, with a double-masking function that operates at both the signal and the transformer’s token levels. The pretrained model was evaluated against a fully supervised baseline using Monte Carlo cross-validation with 100 splits across three public pathology detection datasets. Pretraining led to consistent improvements in both median balanced accuracy and Inter-Quartile Range (IQR) across all fine-tuning datasets. Compared to the fully supervised baseline, the proposed approach increases median balanced accuracy by 2.8% for Parkinson’s disease detection and by 4.2% for Alzheimer’s disease detection, while also reducing performance variability across 100 Monte Carlo splits. These results demonstrate that SSL can enhance EEG deep learning performance, though achieving robust generalization in clinical applications remains an open research challenge.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: EEG and Brain-Computer Interfaces · Functional Brain Connectivity Studies · Emotion and Mood Recognition

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Information Engineering, University of Padua, 35131 Padua, Italy

Padova Neuroscience Center, University of Padua, 35129 Padua, Italy

Department of Neuroscience, University of Padua, 35121 Padua, Italy

Department of Biomedical Sciences, University of Padua, 35131 Padua, Italy

Information Systems Institute, University of Applied Sciences Western Switzerland (HES-SO Valais), 3960 Sierre, Switzerland

Funding

European Union

References (32)

Show source-provided references
1. Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review10.1016/j.inffus.2020.01.011 ↗
2. Loh, H.W., Ooi, C.P., Vicnesh, J., Oh, S.L., Faust, O., Gertych, A., and Acharya, U.R. (2020). Automated Detection of Sleep Stages Using Deep Learning Techniques: A Systematic Review of the Last Decade (2010–2020). Appl. Sci., 10.10.3390/app10248963 ↗
3. Machine Learning for Predicting Epileptic Seizures Using EEG Signals: A Review10.1109/RBME.2020.3008792 ↗
4. A comprehensive review of EEG-based brain-computer interface paradigms10.1088/1741-2552/aaf12e ↗
5. Clinical correlates of quantitative EEG in Parkinson disease: A systematic review10.1212/WNL.0000000000006473 ↗
6. The More, the Better? Evaluating the Role of EEG Preprocessing for Deep Learning Applications10.1109/TNSRE.2025.3547616 ↗
7. The OpenNeuro resource for sharing of neuroscience data10.7554/eLife.71774 ↗
8. The role of data partitioning on the performance of EEG-based deep learning models in supervised cross-subject analysis: A preliminary study10.1016/j.compbiomed.2025.110608 ↗
9. Kamrud, A., Borghetti, B., and Schubert Kabban, C. (2021). The Effects of Individual Differences, Non-Stationarity, and the Importance of Data Partitioning Decisions for Training and Testing of EEG Cross-Participant Models. Sensors, 21.10.3390/s21093225 ↗
10. Brookshire, G., Kasper, J., Blauch, N.M., Wu, Y.C., Glatt, R., Merrill, D.A., Gerrol, S., Yoder, K.J., Quirk, C., and Lucero, C. (2024). Data leakage in deep learning studies of translational EEG. Front. Neurosci., 18.10.3389/fnins.2024.1373515 ↗
11. TransformEEG: Towards improving model generalizability in deep learning-based EEG Parkinson’s disease detection10.1016/j.neucom.2025.132075 ↗
12. Balestriero, R., Ibrahim, M., Sobal, V., Morcos, A., Shekhar, S., Goldstein, T., Bordes, F., Bardes, A., Mialon, G., and Tian, Y. (2023). A cookbook of self-supervised learning. arXiv.
13. Self-Supervised Learning for Electroencephalography10.1109/TNNLS.2022.3190448 ↗
14. Liu, Z., Alavi, A., Li, M., and Zhang, X. (2023). Self-Supervised Contrastive Learning for Medical Time Series: A Systematic Review. Sensors, 23.10.3390/s23094221 ↗
15. Mohsenvand, M.N., Izadi, M.R., and Maes, P. (2020, January 11). Contrastive Representation Learning for Electroencephalogram Classification. Proceedings of the Machine Learning for Health NeurIPS Workshop, Virtual Event.
16. Uncovering the structure of clinical EEG signals with self-supervised learning10.1088/1741-2552/abca18 ↗
17. Mohammadi Foumani, N., Mackellar, G., Ghane, S., Irtza, S., Nguyen, N., and Salehi, M. (2024, January 25–29). EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputs. Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Barcelona, Spain. KDD ’24.10.1145/3637528.3671600 ↗
18. Bardes, A., Ponce, J., and LeCun, Y. (2022, January 25–29). VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning. Proceedings of the International Conference on Learning Representations, Virtually.
19. Obeid, I., and Picone, J. (2016). The temple university hospital EEG data corpus. Front. Neurosci., 10.10.3389/fnins.2016.00196 ↗
20. Deep learning-based electroencephalography analysis: A systematic review10.1088/1741-2552/ab260c ↗
21. American clinical neurophysiology society guideline 1: Minimum technical requirements for performing clinical electroencephalography10.1097/WNP.0000000000000308 ↗
22. BIDSAlign: A library for automatic merging and preprocessing of multiple EEG repositories10.1088/1741-2552/ad6a8c ↗
23. EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis10.1016/j.jneumeth.2003.10.009 ↗
24. Koch, G., Zemel, R., and Salakhutdinov, R. (2015, January 10–11). Siamese neural networks for one-shot image recognition. Proceedings of the ICML Deep Learning Workshop, Lille, France.
25. Chen, T., Kornblith, S., Norouzi, M., and Hinton, G. (2020, January 13–18). A Simple Framework for Contrastive Learning of Visual Representations. Proceedings of the 37th International Conference on Machine Learning, Vienna, Austria.
26. Lemkhenter, A., and Favaro, P. (2021). Boosting Generalization in Bio-signal Classification by Learning the Phase-Amplitude Coupling. Pattern Recognition, Springer.10.1007/978-3-030-71278-5_6 ↗
27. SelfEEG: A Python library for Self-Supervised Learning in Electroencephalography10.21105/joss.06224 ↗
28. Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., and Antiga, L. Pytorch: An imperative style, high-performance deep learning library. Proceedings of the 33rd International Conference on Neural Information Processing Systems.
29. seaborn: Statistical data visualization10.21105/joss.03021 ↗
30. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L.u., and Polosukhin, I. Attention is All you Need. Proceedings of the 31st International Conference on Neural Information Processing Systems.
31. Kingma, D., and Ba, J. (2015). Adam: A Method for Stochastic Optimization. arXiv.
32. The UK Biobank resource with deep phenotyping and genomic data10.1038/s41586-018-0579-z ↗