Semantic Latent Geometry Reveals Imagination–Perception Structure in EEG
Source abstract
Abstract
We investigate whether representation-level, semantic diagnostics expose structure in electroencephalography (EEG) beyond conventional accuracy when contrasting perception and imagination and relating outcomes to self-reported imagery ability. Using a task-independent encoder that preserves scalp topology and temporal dependencies, we learn semantic features from multi-subject, multi-modal EEG (pictorial, orthographic, auditory) and evaluate subject-independent decoding with lightweight heads, achieving state-of-the-art or better accuracy with low variance across subjects. To probe the latent space directly, we introduce threshold-resolved correlation pruning and derive the Semantic Sensitivity Index (SSI) and cross-modal overlap (CMO). While correlations between Vividness of Visual Imagery Questionnaire (VVIQ)/Bucknell Auditory Imagery Scale (BAIS) and leave-one-subject-out (LOSO) accuracy are small and imprecise at n = 12, the semantic diagnostics reveal interpretable geometry: for several subjects, imagination retains a more compact, non-redundant latent subset than perception (positive SSI), and a substantial cross-modal core emerges (CMO ≈ 0.5–0.8). These effects suggest that accuracy alone under-reports cognitive organization in the learned space and that semantic compactness and redundancy patterns capture person-specific phase preferences. Given the small cohort and the subjectivity of questionnaires, the findings argue for semantic, representation-aware evaluation as a necessary complement to accuracy in EEG-based decoding and trait linkage.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Face Recognition and Perception · EEG and Brain-Computer Interfaces · Neurobiology of Language and Bilingualism
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Mathematical Biology and Physiology, Department of Electronics and Telecommunications, Politecnico di Torino, 10129 Turin, Italy
References (35)
Show source-provided references
1. Language outside the focus of attention: The mismatch negativity as a tool for studying higher cognitive processes10.1016/j.pneurobio.2006.04.004 ↗
2. Michel, C.M., and Brunet, D. (2019). EEG Source Imaging: A Practical Review of the Analysis Steps. Front. Neurol., 10.10.3389/fneur.2019.00325 ↗
3. Is visual imagery really visual? Overlooked evidence from neuropsychology10.1037/0033-295X.95.3.307 ↗
4. Neural foundations of imagery10.1038/35090055 ↗
5. Vividness of Visual Imagery Depends on the Neural Overlap with Perception in Visual Areas10.1523/JNEUROSCI.3022-16.2016 ↗
6. Where Is the Semantic System? A Critical Review and Meta-Analysis of 120 Functional Neuroimaging Studies10.1093/cercor/bhp055 ↗
7. The Future of Memory: Remembering, Imagining, and the Brain10.1016/j.neuron.2012.11.001 ↗
8. Neural Decoding of Semantic Concepts: A Systematic Literature Review10.1088/1741-2552/ac619a ↗
9. Rekrut, M., Sharma, M., Schmitt, M., Alexandersson, J., and Krüger, A. (2020, January 26–28). Decoding Semantic Categories from EEG Activity in Object-Based Decision Tasks. Proceedings of the 2020 8th International Winter Conference on Brain-Computer Interface (BCI), Gangwon, Republic of Korea.10.1109/BCI48061.2020.9061628 ↗
10. Lee, K.-W., Lee, D.-H., Kim, S.-J., and Lee, S.-W. (2022, January 11–15). Decoding Neural Correlation of Language-Specific Imagined Speech using EEG Signals. Proceedings of the 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Glasgow, UK.10.1109/EMBC48229.2022.9871721 ↗
11. Enhancing MI EEG Signal Classification With a Novel Weighted and Stacked Adaptive Integrated Ensemble Model: A Multi-Dataset Approach10.1109/ACCESS.2024.3434654 ↗
12. Ahmadi, H., Costa, P., and Mesin, L. (2024). A Novel Hierarchical Binary Classification for Coma Outcome Prediction Using EEG, CNN, and Traditional ML Approaches. TechRxiv.10.36227/techrxiv.173220750.05940724/v1 ↗
13. Adversarial Neural Network Training for Secure and Robust Brain-to-Brain Communication10.1109/ACCESS.2024.3376657 ↗
14. Securing Brain-to-Brain Communication Channels Using Adversarial Training on SSVEP EEG10.1109/ACCESS.2025.3528770 ↗
15. Visual imagery differences in the recall of pictures10.1111/j.2044-8295.1973.tb01322.x ↗
16. Commonality of neural representations of words and pictures10.1016/j.neuroimage.2010.10.042 ↗
17. Differences in auditory imagery self-report predict neural and behavioral outcomes10.1037/pmu0000081 ↗
18. Rueschemeyer, A. (2014). Cross-Modal Integration of Lexical-Semantic Features during Word Processing: Evidence from Oscillatory Dynamics during EEG. PLoS ONE, 9.10.1371/journal.pone.0101042 ↗
19. Huang, J., Chang, Y., Li, W., Tong, J., and Du, S. (2024). A Spatio-Temporal Capsule Neural Network with Self-Correlation Routing for EEG Decoding of Semantic Concepts of Imagination and Perception Tasks. Sensors, 24.10.3390/s24185988 ↗
20. Chen, H., He, L., Liu, Y., and Yang, L. (2024). Visual Neural Decoding via Improved Visual-EEG Semantic Consistency. arXiv, Available online: https://arxiv.org/abs/2408.06788.
21. Universal semantic feature extraction from EEG signals: A task-independent framework10.1088/1741-2552/add08f ↗
22. Fahimi Hnazaee, M., Khachatryan, E., and Van Hulle, M.M. (2018). Semantic Features Reveal Different Networks During Word Processing: An EEG Source Localization Study. Front. Hum. Neurosci., 12.10.3389/fnhum.2018.00503 ↗
23. DM-RE2I: A Framework Based on Diffusion Model for the Reconstruction from EEG to Image10.1016/j.bspc.2023.105125 ↗
24. Ahmadi, H., and Mesin, L. (2025, January 14–17). Decoding Visual Imagination and Perception from EEG via Topomap Sequences. Proceedings of the 2025 47th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Copenhagen, Denmark.10.1109/EMBC58623.2025.11251641 ↗
25. DCAE: A Dual Conditional Autoencoder Framework for the Reconstruction from EEG into Image10.1016/j.bspc.2022.104440 ↗
26. EEG-based BCI Dataset of Semantic Concepts for Imagination and Perception Tasks10.1038/s41597-023-02287-9 ↗
27. Deep Wavelet Self-Attention Non-negative Tensor Factorization for non-linear analysis and classification of fMRI data10.1016/j.asoc.2025.113522 ↗
28. EEGNet: A compact convolutional neural network for EEG-based brain-computer interfaces10.1088/1741-2552/aace8c ↗
29. Deep learning with convolutional neural networks for EEG decoding and visualization10.1002/hbm.23730 ↗
30. Sabour, S., Frosst, N., and Hinton, G.E. (2017). Dynamic Routing Between Capsules. arXiv, Available online: https://arxiv.org/abs/1710.09829.
31. Song, Y., Jia, X., Yang, L., and Xie, L. (2021). Transformer-based Spatial-Temporal Feature Learning for EEG Decoding. arXiv, Available online: https://arxiv.org/abs/2106.11170.
32. Liu, Z., Mao, H., Wu, C., Feichtenhofer, C., Darrell, T., and Xie, S. (2022). A ConvNet for the 2020s. arXiv, Available online: https://arxiv.org/abs/2201.03545.10.1109/CVPR52688.2022.01167 ↗
33. Emotion recognition from EEG based on multi-task learning with capsule network and attention mechanism10.1016/j.compbiomed.2022.105303 ↗
34. EEG Conformer: Convolutional Transformer for EEG Decoding and Visualization10.1109/TNSRE.2022.3230250 ↗
35. LMDA-Net: A lightweight multi-dimensional attention network for general EEG-based brain-computer interfaces and interpretability10.1016/j.neuroimage.2023.120209 ↗