journal article·2025-09-29Open access

Decoding Emotions from fNIRS: A Survey on Tensor-Based Approaches in Affective Computing and Medical Applications

Aleksandra Kawala-Sterniuk, Michal Podpora, Dariusz Mikolajewski, Maciej Piasecki, Ewa Rudnicka, Adrian Luckiewicz, Adam Sudol, Mariusz Pelc

Applied Sciences· Volume 15· Issue 19

Abstract

Understanding and interpreting human emotions through neurophysiological signals has become a central goal in affective computing. This paper presents a focused survey of recent advances in emotion recognition using tensor factorization techniques specifically applied to functional Near-Infrared Spectroscopy (fNIRS) data. We examine how tensor-based frameworks have been leveraged to capture the temporal, spatial, and spectral characteristics of fNIRS brain signals, enabling effective dimensionality reduction and latent pattern extraction. Focusing on third-order tensor constructions (trials × channels × time), we compare the use of Canonical Polyadic (CP) and Tucker decompositions in isolating components representative of emotional states. The review further evaluates the performance of extracted features when classified by conventional machine learning models such as Random Forests and Support Vector Machines. Emphasis is placed on comparative accuracy, interpretability, and the advantages of tensor methods over traditional approaches for distinguishing arousal and valence levels. We conclude by discussing the relevance of these methods for the development of real-time, explainable, emotion-aware systems in wearable neurotechnology, with a particular focus on medical applications such as mental health monitoring, early diagnosis of affective disorders, and personalized neurorehabilitation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Tensor decomposition and applications · Anomaly Detection Techniques and Applications · Emotion and Mood Recognition

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Artificial Intelligence, Faculty of Information and Communication Technology, Wroclaw University of Science and Technology, 50-370 Wroclaw, Poland

Institute of Computer Science, University of Opole, 45-758 Opole, Poland

Faculty of Computer Science, Kazimierz Wielki University, 85-064 Bydgoszcz, Poland

Neuropsychological Research Unit, 2nd Clinic of the Psychiatry and Psychiatric Rehabilitation, Medical University in Lublin, 20-059 Lublin, Poland

Faculty of Electrical Engineering, Warsaw University of Technology, 00-662 Warsaw, Poland

Department of Technical Sciences, University of Applied Sciences in Nysa, 48-300 Nysa, Poland

School of Computing and Mathematical Sciences, University of Greenwich, London SE10 9LS, UK

References (65)

Show source-provided references
1. A systematic review on affective computing: Emotion models, databases, and recent advances10.1016/j.inffus.2022.03.009 ↗
2. Affective computing: Recent advances, challenges, and future trends10.34133/icomputing.0076 ↗
3. A comprehensive survey on affective computing; challenges, trends, applications, and future directions10.1109/ACCESS.2024.3422480 ↗
4. From lab to life: Challenges and perspectives of fNIRS for haemodynamic-based neurofeedback in real-world environments10.1098/rstb.2023.0087 ↗
5. Affective relevance10.1109/MIS.2024.3391508 ↗
6. Dehais, F., Ayaz, H., Kawala-Sterniuk, A., Ladouce, S., Barreto, C., and Karwowski, W. (2024). Non-Invasive Brain-Computer Interfaces. Interaction Techniques and Technologies in Human-Computer Interaction, CRC Press.10.1201/9781003490678-14 ↗
7. Friedman, B.H., and Thayer, J.F. (2024). Is emotion physiology more compatible with discrete, dimensional, or appraisal accounts?. Emotion Theory: The Routledge Comprehensive Guide, Routledge.10.4324/9781315559940-26 ↗
8. Kragel, P.A., Sander, D., and LaBar, K.S. (2024). Can Brain Data Be Used to Arbitrate Among Emotion Theories?. Emotion Theory: The Routledge Comprehensive Guide, Routledge.10.4324/9781315559940-27 ↗
9. The present and future use of functional near-infrared spectroscopy (fNIRS) for cognitive neuroscience10.1111/nyas.13948 ↗
10. A brief review on the history of human functional near-infrared spectroscopy (fNIRS) development and fields of application10.1016/j.neuroimage.2012.03.049 ↗
11. Big team science reveals promises and limitations of machine learning efforts to model physiological markers of affective experience10.1098/rsos.241778 ↗
12. Toward Explainable Affective Computing: A Review10.1109/TNNLS.2023.3270027 ↗
13. Dimensionality reduction methods for brain imaging data analysis10.1145/3448302 ↗
14. Taguchi, Y. (2017). Tensor decomposition-based unsupervised feature extraction applied to matrix products for multi-view data processing. PLoS ONE, 12.10.1371/journal.pone.0183933 ↗
15. Twenty years of functional near-infrared spectroscopy: Introduction for the special issue10.1016/j.neuroimage.2013.11.033 ↗
16. Naseer, N., and Hong, K.S. (2015). fNIRS-based brain-computer interfaces: A review. Front. Hum. Neurosci., 9.10.3389/fnhum.2015.00003 ↗
17. Assessment of the cerebral cortex during motor task behaviours in adults: A systematic review of functional near infrared spectroscopy (fNIRS) studies10.1016/j.neuroimage.2010.10.058 ↗
18. Causse, M., Chua, Z., Peysakhovich, V., Del Campo, N., and Matton, N. (2017). Mental workload and neural efficiency quantified in the prefrontal cortex using fNIRS. Sci. Rep., 7.10.1038/s41598-017-05378-x ↗
19. Paulmurugan, K., Vijayaragavan, V., Ghosh, S., Padmanabhan, P., and Gulyás, B. (2021). Brain–computer interfacing using functional near-infrared spectroscopy (fNIRS). Biosensors, 11.10.3390/bios11100389 ↗
20. Zhao, Q., Zhao, W., Lu, C., Du, H., and Chi, P. (2024). Interpersonal neural synchronization during social interactions in close relationships: A systematic review and meta-analysis of fNIRS hyperscanning studies. Neurosci. Biobehav. Rev., 158.10.1016/j.neubiorev.2024.105565 ↗
21. Inter-brain amplitude correlation differentiates cooperation from competition in a motion-sensing sports game10.1093/scan/nsab031 ↗
22. Chen, G., Liu, Y., and Zhang, X. (2024). EEG–fNIRS-Based emotion recognition using graph convolution and capsule attention network. Brain Sci., 14.10.3390/brainsci14080820 ↗
23. Detection of emotional sensitivity using fNIRS based dynamic functional connectivity10.1109/TNSRE.2021.3078460 ↗
24. Ruotsalo, T., Mäkelä, K., Spapé, M.M., and Leiva, L.A. (2023, January 23–27). Affective relevance: Inferring emotional responses via fNIRS neuroimaging. Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, Taipei, Taiwan.10.1145/3539618.3591946 ↗
25. Affective brain–computer interfaces (abcis): A tutorial10.1109/JPROC.2023.3277471 ↗
26. Spatial sensitivity and penetration depth of three cerebral oxygenation monitors10.1364/BOE.5.002896 ↗
27. Li, R., Yang, D., Fang, F., Hong, K.S., Reiss, A.L., and Zhang, Y. (2022). Concurrent fNIRS and EEG for brain function investigation: A systematic, methodology-focused review. Sensors, 22.10.3390/s22155865 ↗
28. NEMO: A Database for Emotion Analysis Using Functional Near-infrared Spectroscopy
29. Yükselen, G., Öztürk, O.C., Canlı, G.D., and Erdoğan, S.B. (2023). Investigating the Neural Correlates of Processing Basic Emotions: A Functional Near-Infrared Spectroscopy (fNIRS) Study. bioRxiv.10.1101/2023.08.08.551979 ↗
30. Si, X., He, H., Yu, J., and Ming, D. (2023). Cross-subject emotion recognition brain–computer interface based on fNIRS and DBJNet. Cyborg Bionic Syst., 4.10.34133/cbsystems.0045 ↗
31. Trambaiolli, L.R., Tiwari, A., and Falk, T.H. (2021). Affective neurofeedback under naturalistic conditions: A mini-review of current achievements and open challenges. Front. Neuroergonomics, 2.10.3389/fnrgo.2021.678981 ↗
32. Doherty, E.J., Spencer, C.A., Burnison, J., Čeko, M., Chin, J., Eloy, L., Haring, K., Kim, P., Pittman, D., and Powers, S. (2023). Interdisciplinary views of fNIRS: Current advancements, equity challenges, and an agenda for future needs of a diverse fNIRS research community. Front. Integr. Neurosci., 17.10.3389/fnint.2023.1059679 ↗
33. Parallel factor analysis for multidimensional decomposition of functional near-infrared spectroscopy data
34. Chan, J., Wilcox, T., Hssayeni, M., and Ghoraani, B. (2022, January 9–12). Multidimensional Analysis of Functional Near-Infrared Spectroscopy (fNIRS) Signal using Tucker Decomposition. Proceedings of the 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Prague, Czech Republic.10.1109/SMC53654.2022.9945539 ↗
35. Chan, J.Y., Hssayeni, M.D., Wilcox, T., and Ghoraani, B. (2023). Exploring the feasibility of tensor decomposition for analysis of fNIRS signals: A comparative study with grand averaging method. Front. Neurosci., 17.10.3389/fnins.2023.1180293 ↗
36. Liu, J., Song, T., Shu, Z., Han, J., and Yu, N. (2021, January 27–31). fNIRS Feature Extraction and Classification in Grip-Force Tasks. Proceedings of the 2021 IEEE International Conference on Robotics and Biomimetics (ROBIO), Sanya, China.10.1109/ROBIO54168.2021.9739514 ↗
37. Cao, Z. (September, January 28). Simple but effective: Rethinking the ability of deep learning in fnirs to exclude abnormal input. Proceedings of the 2024 IEEE 20th International Conference on Automation Science and Engineering (CASE), Bari, Italy.10.1109/CASE59546.2024.10711774 ↗
38. Hu, H., Lin, X., Ye, Z., Fang, L., Gao, H., and Zhang, Q. (2024). Application of functional near-infrared spectroscopy (fNIRS) in tinnitus research: Contemporary insights and perspectives. Front. Psychol., 15.10.3389/fpsyg.2024.1334660 ↗
39. Tensor decomposition for model reduction in neural networks: A review [feature]10.1109/MCAS.2023.3267921 ↗
40. Wang, C., Sahebi, S., and Torkamaan, H. (2021, January 14–17). STRETCH: Stress and Behavior Modeling with Tensor Decomposition of Heterogeneous Data. Proceedings of the IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, Melbourne, VIC, Australia. WI-IAT’21.10.1145/3486622.3493967 ↗
41. Liao, C.Y., Li, C.Y., and Fang, W.C. (2021, January 15–17). AI-Based Emotion Recognition System with Tensor Decomposition Optimized Pre-processing. Proceedings of the 2021 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW), Penghu, Taiwan.10.1109/ICCE-TW52618.2021.9603114 ↗
42. Tensor Decomposition for Multiple-Instance Classification of High-Order Medical Data10.1155/2018/8651930 ↗
43. Optimization methods for tensor decomposition: A comparison of new algorithms for fitting the CP (CANDECOMP/PARAFAC) model10.1016/j.chemolab.2024.105290 ↗
44. Sztuka, I.M., and Kühn, S. (2025). Neurocognitive dynamics and behavioral differences of symmetry and asymmetry processing in working memory: Insights from fNIRS. Sci. Rep., 15.10.1038/s41598-024-84988-8 ↗
45. Auddy, A., Xia, D., and Yuan, M. (2024). Tensor methods in high dimensional data analysis: Opportunities and challenges. arXiv.
46. Tensor methods in biomedical image analysis10.4103/jmss.jmss_55_23 ↗
47. Machine learning studies on major brain diseases: 5-year trends of 2014–201810.1007/s11604-018-0794-4 ↗
48. Lima, A.A., Mridha, M.F., Das, S.C., Kabir, M.M., Islam, M.R., and Watanobe, Y. (2022). A comprehensive survey on the detection, classification, and challenges of neurological disorders. Biology, 11.10.3390/biology11030469 ↗
49. Hamdi, S.M., Wu, Y., Boubrahimi, S.F., Angryk, R., Krishnamurthy, L.C., and Morris, R. (2018, January 7–9). Tensor decomposition for neurodevelopmental disorder prediction. Proceedings of the Brain Informatics: International Conference, BI 2018, Arlington, TX, USA.10.1007/978-3-030-05587-5_32 ↗
50. Tensor analysis and fusion of multimodal brain images10.1109/JPROC.2015.2455028 ↗
51. Joshi, R., and Jadeja, M. (2024). The Synergy of Clinical Psychology and Affective Computing: Advancements in Emotion Recognition and Therapy. Affective Computing for Social Good: Enhancing Well-Being, Empathy, and Equity, Springer.10.1007/978-3-031-63821-3_2 ↗
52. Functional near-infrared spectroscopy (fNIRS): Principles and neuroscientific applications
53. Quaresima, V., and Ferrari, M. (2019). A mini-review on functional near-infrared spectroscopy (fNIRS): Where do we stand, and where should we go?. Photonics, 6.10.3390/photonics6030087 ↗
54. Udina, C., Avtzi, S., Durduran, T., Holtzer, R., Rosso, A.L., Castellano-Tejedor, C., Perez, L.M., Soto-Bagaria, L., and Inzitari, M. (2020). Functional near-infrared spectroscopy to study cerebral hemodynamics in older adults during cognitive and motor tasks: A review. Front. Aging Neurosci., 11.10.3389/fnagi.2019.00367 ↗
55. Ahmed, I., and Raihan, A.S. (2024). Spatiotemporal data analysis: A review of techniques, applications, and emerging challenges. Multimodal and Tensor Data Analytics for Industrial Systems Improvement, Springer.10.1007/978-3-031-53092-0_7 ↗
56. Subject-Specific Modeling of EEG-fNIRS Neurovascular Coupling by Task-Related Tensor Decomposition10.1109/TNSRE.2024.3355121 ↗
57. Hssayeni, M.D., Wilcox, T., and Ghoraani, B. (2020, January 20–24). Tensor decomposition of functional near-infrared spectroscopy (fNIRS) signals for pattern discovery of cognitive response in infants. Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Montreal, QC, Canada.10.1109/EMBC44109.2020.9176115 ↗
58. Sinha, N. (2021). Affective computing and emotion-sensing technology for emotion recognition in mood disorders. Enhanced Telemedicine and e-Health: Advanced IoT Enabled Soft Computing Framework, Springer.10.1007/978-3-030-70111-6_16 ↗
59. Hou, M., Zhang, X., Chen, G., Huang, L., and Sun, Y. (2024). Emotion Recognition Based on a EEG–fNIRS Hybrid Brain Network in the Source Space. Brain Sci., 14.10.3390/brainsci14121166 ↗
60. Akhter, J., Nazeer, H., Naseer, N., Naeem, R., Kallu, K.D., Lee, J., and Ko, S.Y. (2025). Improved performance of fNIRS-BCI by stacking of deep learning-derived frequency domain features. PloS ONE, 20.10.1371/journal.pone.0314447 ↗
61. Barnhardt, T.M., Chan, J.Y., Ghoraani, B., and Wilcox, T. (2025). Effects of Competition on Left Prefrontal and Temporal Cortex During Conceptual Comparison of Brand-Name Product Pictures: Analysis of fNIRS Using Tensor Decomposition. Brain Sci., 15.10.3390/brainsci15020127 ↗
62. Erol, A., and Hunyadi, B. (2022). Tensors for neuroimaging: A review on applications of tensors to unravel the mysteries of the brain. Tensors for Data Processing, Academic Press.10.1016/B978-0-12-824447-0.00018-2 ↗
63. Halkiopoulos, C., Gkintoni, E., Aroutzidis, A., and Antonopoulou, H. (2025). Advances in Neuroimaging and Deep Learning for Emotion Detection: A Systematic Review of Cognitive Neuroscience and Algorithmic Innovations. Diagnostics, 15.10.3390/diagnostics15040456 ↗
64. Aranyi, G., Pecune, F., Charles, F., Pelachaud, C., and Cavazza, M. (2015). Affective Interaction with a Virtual Character Through an fNIRS Brain-Computer Interface. Front. Comput. Neurosci., 10.10.3389/fncom.2016.00070 ↗
65. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews10.1136/bmj.n71 ↗