journal article·2026-06-01Open access

Optimal Transport and Graph Neural Networks for Cross-Session Mental Workload Classification

Güliz Demirezen, Anne-Marie Brouwer, Tuğba Taşkaya Temizel

Applied Sciences· Volume 16· Issue 11

Abstract

Electroencephalography (EEG) offers a noninvasive, high-temporal-resolution modality for estimating mental workload. However, session-to-session variability limits the generalizability of workload classifiers, and few systematic cross-session evaluations are reported in the literature. This study systematically evaluates domain adaptation methods for cross-session mental workload classification using the publicly available COG-BCI dataset within an evaluation framework that may guide future studies on EEG-based classification models. We make four contributions: (i) integration of Optimal Transport (OT) with Graph Neural Networks (GNNs) to model spatial relationships and align feature distributions under strict session-wise separation; (ii) a data-centric evaluation pipeline incorporating Self-Organizing Map (SOM) visualizations for data exploration and a heuristic loss function for model selection; (iii) a strict cross-session protocol examining the effects of graph construction, feature selection, and data splits; and (iv) comparison of OT with CORrelation ALignment (CORAL) and GNN with EEGNet. Incorporating OT improved test accuracies across all experimental configurations. SOM visualizations confirmed enhanced feature alignment after OT. Our results highlight the potential of OT for mitigating session-to-session variability and underscore the importance of a data-centric approach and rigorous cross-session evaluation when developing classifiers for complex cognitive state estimation. Future work should explore semi-supervised OT strategies and scalable implementations for real-time applications.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: EEG and Brain-Computer Interfaces · Ferroelectric and Negative Capacitance Devices · Functional Brain Connectivity Studies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Information Systems, Graduate School of Informatics, Middle East Technical University, Ankara 06800, Türkiye

Human Performance, Netherlands Organisation for Applied Scientific Research (TNO), 3769 DE Soesterberg, The Netherlands

Artificial Intelligence, Donders Institute for Brain, Cognition and Behaviour, Radboud University, 6525 GD Nijmegen, The Netherlands

Department of Data Informatics, Graduate School of Informatics, Middle East Technical University, Ankara 06800, Türkiye

References (88)

Show source-provided references
1. State of science: Mental workload in ergonomics10.1080/00140139.2014.956151 ↗
2. Multiple resources and mental workload10.1518/001872008X288394 ↗
3. What is the relationship between mental workload factors and cognitive load types?10.1016/j.ijpsycho.2011.09.023 ↗
4. Monitoring Working Memory Load during Computer-Based Tasks with EEG Pattern Recognition Methods10.1518/001872098779480578 ↗
5. EEG alpha and theta oscillations reflect cognitive and memory performance: A review and analysis10.1016/S0165-0173(98)00056-3 ↗
6. Estimating brain load from the EEG10.1100/tsw.2009.83 ↗
7. Estimating workload using EEG spectral power and ERPs in the n-back task10.1088/1741-2560/9/4/045008 ↗
8. Yu, S., Tian, L., Wang, G., and Nie, S. (2024). Which ERP components are effective in measuring cognitive load in multimedia learning? A meta-analysis based on relevant studies. Front. Psychol., 15.10.3389/fpsyg.2024.1401005 ↗
9. ERP based measures of cognitive workload: A review10.1016/j.neubiorev.2020.07.020 ↗
10. Monitoring task loading with multivariate EEG measures during complex forms of human-computer interaction10.1518/001872001775898287 ↗
11. STEW: Simultaneous task EEG workload data set10.1109/TNSRE.2018.2872924 ↗
12. Fronto-parietal EEG coherence in theta and upper alpha reflect central executive functions of working memory10.1016/j.ijpsycho.2005.03.018 ↗
13. Plechawska-Wójcik, M., Tokovarov, M., Kaczorowska, M., and Zapała, D. (2019). A three-class classification of cognitive workload based on EEG spectral data. Appl. Sci., 9.10.3390/app9245340 ↗
14. Benerradi, J., A. Maior, H., Marinescu, A., Clos, J., and Wilson, M.L. (2019). Exploring machine learning approaches for classifying mental workload using fNIRS data from HCI tasks. Proceedings of the Halfway to the Future Symposium 2019, Association for Computing Machinery. HttF ’19.10.1145/3363384.3363392 ↗
15. So, W.K., Wong, S.W., Mak, J.N., and Chan, R.H. (2017). An evaluation of mental workload with frontal EEG. PLoS ONE, 12.10.1371/journal.pone.0174949 ↗
16. Aghajani, H., Garbey, M., and Omurtag, A. (2017). Measuring mental workload with EEG + fNIRS. Front. Hum. Neurosci., 11.10.3389/fnhum.2017.00359 ↗
17. Adaptive training using an artificial neural network and EEG metrics for within-and cross-task workload classification10.1016/j.neuroimage.2011.07.047 ↗
18. EEG based cognitive workload classification during NASA MATB-II multitasking
19. Saadati, M., Nelson, J., and Ayaz, H. (2019). Convolutional neural network for hybrid fNIRS-EEG mental workload classification. Proceedings of the Advances in Neuroergonomics and Cognitive Engineering, Springer.10.1007/978-3-030-20473-0_22 ↗
20. EEG -based mental workload estimation using deep BLSTM-LSTM network and evolutionary algorithm10.1016/j.bspc.2020.101989 ↗
21. Asgher, U., Khalil, K., Khan, M.J., Ahmad, R., Butt, S.I., Ayaz, Y., Naseer, N., and Nazir, S. (2020). Enhanced accuracy for multiclass mental workload detection using long short-term memory for brain–computer interface. Front. Neurosci., 14.10.3389/fnins.2020.00584 ↗
22. A comprehensive survey on graph neural networks10.1109/TNNLS.2020.2978386 ↗
23. EEG emotion recognition using dynamical graph convolutional neural networks10.1109/TAFFC.2018.2817622 ↗
24. EEG-based emotion recognition using regularized graph neural networks10.1109/TAFFC.2020.2994159 ↗
25. Graph Neural Network-Based EEG Classification: A Survey10.1109/TNSRE.2024.3355750 ↗
26. Saha, S., and Baumert, M. (2020). Intra- and Inter-subject Variability in EEG-Based Sensorimotor Brain Computer Interface: A Review. Front. Comput. Neurosci., 13.10.3389/fncom.2019.00087 ↗
27. Transfer learning for EEG -based brain–computer interfaces: A review of progress made since 201610.1109/TCDS.2020.3007453 ↗
28. A large EEG dataset for studying cross-session variability in motor imagery brain-computer interface10.1038/s41597-022-01647-1 ↗
29. Huang, G., Zhao, Z., Zhang, S., Hu, Z., Fan, J., Fu, M., Chen, J., Xiao, Y., Wang, J., and Dan, G. (2023). Discrepancy between inter- and intra-subject variability in EEG-based motor imagery brain-computer interface: Evidence from multiple perspectives. Front. Neurosci., 17.10.3389/fnins.2023.1122661 ↗
30. Recent Advances in Optimal Transport for Machine Learning10.1109/TPAMI.2024.3489030 ↗
31. Chambon, S., Galtier, M.N., and Gramfort, A. (2018, January 12–14). Domain adaptation with optimal transport improves EEG sleep stage classifiers. Proceedings of the 2018 International Workshop on Pattern Recognition in Neuroimaging (PRNI), Singapore.10.1109/PRNI.2018.8423957 ↗
32. Convolution Monge Mapping Normalization for learning on sleep data
33. Semi-supervised EEG-based emotion recognition method by optimal transport distribution matching10.1088/2631-8695/adb00d ↗
34. Transfer Learning Based on Optimal Transport for Motor Imagery Brain-Computer Interfaces10.1109/TBME.2021.3105912 ↗
35. Transfer learning with optimal transportation and frequency mixup for EEG-based motor imagery recognition10.1109/TNSRE.2022.3211881 ↗
36. Three-stage transfer learning for motor imagery EEG recognition10.1007/s11517-024-03036-9 ↗
37. Demirezen, G., Taşkaya Temizel, T., and Brouwer, A.M. (2024). Reproducible machine learning research in mental workload classification using EEG. Front. Neuroergon., 5.10.3389/fnrgo.2024.1346794 ↗
38. Mental Workload Assessment Using Deep Learning Models From EEG Signals: A Systematic Review10.1109/TCDS.2024.3460750 ↗
39. Hinss, M.F., Jahanpour, E.S., Somon, B., Pluchon, L., Dehais, F., and Roy, R.N. COG-BCI Database: A Multi-Session and Multi-Task EEG Cognitive Dataset for Passive Brain-Computer Interfaces, Online Dataset.
40. A review of classification algorithms for EEG-based brain–computer interfaces: A 10 year update10.1088/1741-2552/aab2f2 ↗
41. Chin, Z.Y., Zhang, X., Wang, C., and Ang, K.K. (2018, January 17–21). EEG-based discrimination of different cognitive workload levels from mental arithmetic. Proceedings of the 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, HI, USA.10.1109/EMBC.2018.8512675 ↗
42. Pušica, M., Mijović, B., Leva, M.C., and Gligorijević, I. (2025). Machine learning performance in EEG-based mental workload classification across task types: A systematic review. Front. Neuroergon., 6.10.3389/fnrgo.2025.1621309 ↗
43. Cain, B. (2007). A Review of the Mental Workload Literature, Defence Research and Development Canada (DRDC), Human Systems Integration Section. Technical Report No. RTO-TR-HFM-121-Part-II.
44. Qu, H., Zhang, M., and Pang, L. (2022). Mental Workload Classification Method Based on EEG Cross-Session Subspace Alignment. Mathematics, 10.10.3390/math10111875 ↗
45. The graph neural network model10.1109/TNN.2008.2005605 ↗
46. Villani, C. (2009). Optimal Transport: Old and New, Springer.10.1007/978-3-540-71050-9 ↗
47. On the Translocation of Masses10.1007/s10958-006-0049-2 ↗
48. Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation
49. Burges, C., Bottou, L., Welling, M., Ghahramani, Z., and Weinberger, K. (2013). Sinkhorn Distances: Lightspeed Computation of Optimal Transport. Proceedings of the Advances in Neural Information Processing Systems, Curran Associates, Inc.
50. Computational Optimal Transport: With Applications to Data Science10.1561/2200000073 ↗
51. Lee, D., Sugiyama, M., Luxburg, U., Guyon, I., and Garnett, R. (2016). Stochastic Optimization for Large-scale Optimal Transport. Proceedings of the Advances in Neural Information Processing Systems, Curran Associates, Inc.
52. Return of Frustratingly Easy Domain Adaptation
53. Open multi-session and multi-task EEG cognitive Dataset for passive brain-computer Interface Applications10.1038/s41597-022-01898-y ↗
54. Santiago-Espada, Y., Myer, R.R., Latorella, K.A., and Comstock, J.R. (2011). The Multi-Attribute Task Battery II (MATB-II) Software for Human Performance and Workload Research: A User’s Guide (NASA/TM-2011-217164), National Aeronautics and Space Administration, Langley Research Center. Technical Report.
55. EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis10.1016/j.jneumeth.2003.10.009 ↗
56. MathWorks Inc (MATLAB, 2023). MATLAB, Version: 9.14.0.2206163 (R2023a).
57. Winkler, I., Debener, S., Müller, K.R., and Tangermann, M. (2015, January 25–29). On the influence of high-pass filtering on ICA-based artifact reduction in EEG-ERP. Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy.10.1109/EMBC.2015.7319296 ↗
58. Enhanced detection of artifacts in EEG data using higher-order statistics and independent component analysis10.1016/j.neuroimage.2006.11.004 ↗
59. Faster Independent Component Analysis by Preconditioning With Hessian Approximations10.1109/TSP.2018.2844203 ↗
60. ICLabel: An automated electroencephalographic independent component classifier, dataset, and website10.1016/j.neuroimage.2019.05.026 ↗
61. Delorme, A., and Makeig, S. (2023). This is no “ICA bug”: Response to the article, “ICA’s bug: How ghost ICs emerge from effective rank deficiency caused by EEG electrode interpolation and incorrect re-referencing”. Front. Neuroimaging, 2.10.3389/fnimg.2023.1331404 ↗
62. Ouyang, D., Yuan, Y., Li, G., and Guo, Z. (2022). The Effect of Time Window Length on EEG-Based Emotion Recognition. Sensors, 22.10.3390/s22134939 ↗
63. Real-Time EEG-Based Cognitive Workload Monitoring on Wearable Devices10.1109/TBME.2021.3092206 ↗
64. Variational Inference for Graph Convolutional Networks in the Absence of Graph Data and Adversarial Settings
65. Weisfeiler and Leman Go Neural: Higher-Order Graph Neural Networks
66. Fey, M., and Lenssen, J.E. (2019, January 6–9). Fast graph representation learning with PyTorch Geometric. Proceedings of the ICLR Workshop on Representation Learning on Graphs and Manifolds, New Orleans, LA, USA.
67. Akiba, T., Sano, S., Yanase, T., Ohta, T., and Koyama, M. (2019, January 15–18). Optuna: A next-generation hyperparameter optimization framework. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, New York, NY, USA. KDD ’19.10.1145/3292500.3330701 ↗
68. Biewald, L. (2023, January 30). Experiment Tracking with Weights and Biases. Available online: https://wandb.com.
69. Statistical comparisons of classifiers over multiple data sets
70. EEGNet: A compact convolutional neural network for EEG-based brain–computer interfaces10.1088/1741-2552/aace8c ↗
71. Deep learning with convolutional neural networks for EEG decoding and visualization10.1002/hbm.23730 ↗
72. Pot: Python optimal transport
73. de Mathelin, A., Deheeger, F., Richard, G., Mougeot, M., and Vayatis, N. (2021). ADAPT: Awesome Domain Adaptation Python Toolbox. arXiv.
74. Using Semi-supervised Domain Adaptation to Enhance EEG-Based Cross-Task Mental Workload Classification Performance10.1109/JBHI.2024.3452410 ↗
75. An Early Warning Approach for Pilots’ Cognitive Tipping Points Based Multi-Modal Signals10.1109/TASE.2024.3384504 ↗
76. Parameterizing neural power spectra into periodic and aperiodic components10.1038/s41593-020-00744-x ↗
77. Enhancing EEG-based cross-day mental workload classification using periodic component of power spectrum10.1088/1741-2552/ad0f3d ↗
78. Independent evaluation of the harvard automated processing pipeline for Electroencephalography 1.0 using multi-site EEG data from children with Fragile X Syndrome10.1016/j.jneumeth.2022.109501 ↗
79. Papatzikis, E. (2025). How to Process Infant Electroencephalography (Eeg) Data: A Critical Review of 10 Preprocessing Pipelines on Challenges, Strengths, and Future Directions. Preprints.10.20944/preprints202504.2375.v1 ↗
80. EEGMeNet: End-to-End Multitask Neural Network for Brain-Based Mental Workload Classification10.1109/JIOT.2025.3593907 ↗
81. The self-organizing map10.1109/5.58325 ↗
82. Essentials of the self-organizing map10.1016/j.neunet.2012.09.018 ↗
83. Roy, R., Hinss, M., Darmet, L., Ladouce, S., Jahanpour, E., Somon, B., Xu, X., Drougard, N., Dehais, F., and Lotte, F. (2022). Retrospective on the First Passive Brain-Computer Interface Competition on Cross-Session Workload Estimation. Front. Neuroergo., 3.10.3389/fnrgo.2022.838342 ↗
84. Better than random: A closer look on BCI results
85. The optimal mass transport problem for relativistic costs10.1007/s00526-011-0485-9 ↗
86. A computational fluid mechanics solution to the Monge-Kantorovich mass transfer problem10.1007/s002110050002 ↗
87. Chen, Q., Liu, Y., Wang, Z., Wassell, I., and Chetty, K. (2018, January 18–23). Re-Weighted Adversarial Adaptation Network for Unsupervised Domain Adaptation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00832 ↗
88. Wasserstein Distance Guided Representation Learning for Domain Adaptation