journal article·2023-05-23Open access

Multimodal Classification of Anxiety Based on Physiological Signals

Mariana Vaz, Teresa Summavielle, Raquel Sebastião, Rita P. Ribeiro

Applied Sciences· Volume 13· Issue 11

Abstract

Multiple studies show an association between anxiety disorders and dysregulation in the Autonomic Nervous System (ANS). Thus, understanding how informative the physiological signals are would contribute to effectively detecting anxiety. This study targets the classification of anxiety as an imbalanced binary classification problem using physiological signals collected from a sample of healthy subjects under a neutral condition. For this purpose, the Electrocardiogram (ECG), Electrodermal Activity (EDA), and Electromyogram (EMG) signals from the WESAD publicly available dataset were used. The neutral condition was collected for around 20 min on 15 participants, and anxiety scores were assessed through the shortened 6-item STAI. To achieve the described goal, the subsequent steps were followed: signal pre-processing; feature extraction, analysis, and selection; and classification of anxiety. The findings of this study allowed us to classify anxiety with discriminatory class features based on physiological signals. Moreover, feature selection revealed that ECG features play a relevant role in anxiety classification. Supervised feature selection and data balancing techniques, especially Borderline SMOTE 2, increased the performance of most classifiers. In particular, the combination of feature selection and Borderline SMOTE 2 achieved the best ROC-AUC with the Random Forest classifier.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: EEG and Brain-Computer Interfaces · Heart Rate Variability and Autonomic Control · ECG Monitoring and Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Computer Science Department, Faculty of Sciences, University of Porto, 4169-007 Porto, Portugal

Addiction Biology Group, i3S—Instituto de Investigação e Inovação em Saúde, 4200-135 Porto, Portugal

Escola Superior de Saúde, Polytechnic of Porto, 4200-072 Porto, Portugal

Institute of Electronics and Informatics Engineering of Aveiro (IEETA), Department of Electronics, Telecommunications and Informatics (DETI), Intelligent Systems Associate Laboratory (LASI), University of Aveiro, 3810-193 Aveiro, Portugal

INESC TEC—Institute for Systems and Computer Engineering, Technology and Science, 4200-465 Porto, Portugal

Funding

Fundação para a Ciência e a Tecnologia

References (43)

Show source-provided references
1. Schmidt, P., Reiss, A., Duerichen, R., and Van Laerhoven, K. (2018, January 16–20). Introducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection. Proceedings of the ICMI 2018: International Conference on Multimodal Interfaces, Boulder, CO, USA.10.1145/3242969.3242985 ↗
2. Health and Safety Executive (2019). Work-Related Stress, Anxiety or Depression Statistics in Great Britain, HSE.
3. Stress, vs. (2021, August 28). Anxiety—Knowing the Difference Is Critical to Your Health—Mental Health First Aid. Available online: https://www.mentalhealthfirstaid.org/external/2018/06/stress-vs-anxiety/.
4. (2021, August 16). Health Status. Available online: https://stats.oecd.org/Index.aspx?DatasetCode=HEALTH_STAT.
5. Psychophysiological Markers of Fear and Anxiety10.1007/s11920-019-1036-x ↗
6. Heart Rate Variability (HRV) in Adolescent Females with Anxiety Disorders and Major Depressive Disorder10.1111/j.1651-2227.2009.01657.x ↗
7. The Neurocircuitry of Fear, Stress, and Anxiety Disorders10.1038/npp.2009.83 ↗
8. Anxiety and Cardiovascular Disease Risk: A Review10.1007/s11886-016-0800-3 ↗
9. An Anxious Heart: Anxiety and the Onset of Cardiovascular Diseases10.1016/j.pcad.2013.03.007 ↗
10. Association between Anxiety Disorders and Heart Rate Variability in the Netherlands Study of Depression and Anxiety (NESDA)10.1097/PSY.0b013e3181a292a6 ↗
11. Differences in Heart Rate Variability between Depressed and Non-Depressed Elderly10.1002/gps.1439 ↗
12. Stress Detection Using Physiological Sensors10.1109/MC.2015.316 ↗
13. A Survey of Machine Learning Techniques in Physiology Based Mental Stress Detection Systems10.1016/j.bbe.2019.01.004 ↗
14. Objective Measures, Sensors and Computational Techniques for Stress Recognition and Classification: A Survey10.1016/j.cmpb.2012.07.003 ↗
15. The Development of a Six-Item Short-Form of the State Scale of the Spielberger State-Trait Anxiety Inventory (STAI)10.1111/j.2044-8260.1992.tb00997.x ↗
16. Psychological Stress Level Detection Based on Electrodermal Activity10.1016/j.bbr.2017.12.021 ↗
17. Schmidt, P., Reiss, A., Dürichen, R., and Laerhoven, K. (2019). Van Wearable-Based Affect Recognition—A Review. Sensors, 19.10.3390/s19194079 ↗
18. Mental Health Monitoring with Multimodal Sensing and Machine Learning: A Survey10.1016/j.pmcj.2018.09.003 ↗
19. Šalkevicius, J., Damaševičius, R., Maskeliunas, R., and Laukienė, I. (2019). Anxiety Level Recognition for Virtual Reality Therapy System Using Physiological Signals. Electronics, 8.10.3390/electronics8091039 ↗
20. Stress Detection in Daily Life Scenarios Using Smartphones and Wearable Sensors: A Survey10.1016/j.jbi.2019.103139 ↗
21. Can, Y.S., Chalabianloo, N., Ekiz, D., and Ersoy, C. (2019). Continuous Stress Detection Using Wearable Sensors in Real Life: Algorithmic Programming Contest Case Study. Sensors, 19.10.3390/s19081849 ↗
22. Stress Level Estimation Based on Physiological Signals for Virtual Reality Applications10.1109/ACCESS.2022.3186318 ↗
23. (2022, September 29). Python Release Python 3.8.0|Python.Org. Available online: https://www.python.org/downloads/release/python-380/.
24. NeuroKit2: A Python Toolbox for Neurophysiological Signal Processing10.3758/s13428-020-01516-y ↗
25. (2022, July 15). Supervised Learning—Scikit-Learn 1.1.1 Documentation. Available online: https://scikit-learn.org/stable/supervised_learning.html#supervised-learning.
26. (2023, January 13). Imbalanced-Learn Documentation—Version 0.10.1. Available online: https://imbalanced-learn.org/stable/.
27. Sörnmo, L., and Laguna, P. (2005). Bioelectrical Signal Processing in Cardiac and Neurological Applications, Elsevier Inc.10.1016/B978-012437552-9/50003-9 ↗
28. Lee, G., Choi, B., Jebelli, H., Ahn, C.R., and Lee, S. (2019, January 17–19). Reference Signal-Based Method to Remove Respiration Noise in Electrodermal Activity (EDA) Collected from the Field. Proceedings of the EventASCE International Conference on Computing in Civil Engineering 2019: Data, Sensing, and Analytics, i3CE 2019, Atalanta, GA, USA.10.1061/9780784482438.003 ↗
29. Measures of Anxiety10.1002/acr.20561 ↗
30. Ferreira, É.D.M.R., Pinto, R.Z., Arantes, P.M.M., Vieira, É.L.M., Teixeira, A.L., Ferreira, F.R., and Vaz, D.V. (2020). Stress, Anxiety, Self-Efficacy, and the Meanings That Physical Therapy Students Attribute to Their Experience with an Objective Structured Clinical Examination. BMC Med. Educ., 20.10.1186/s12909-020-02202-5 ↗
31. A Survey of Predictive Modeling on Imbalanced Domains
32. An Overview of Heart Rate Variability Metrics and Norms10.3389/fpubh.2017.00258 ↗
33. Sklearn (2022, March 28). Feature_Selection. RFECV. Scikit-Learn 1.0.2 Documentation. Available online: https://scikit-learn.org/stable/modules/generated/sklearn.feature_selection.RFECV.html?msclkid=90a2afc1ae3011ec8a4ab8a1dcf666f4.
34. Flach, P. (2012). Machine Learning: The Art and Science of Algorithms That Make Sense of Data, Cambridge University Press.10.1017/CBO9780511973000 ↗
35. SMOTE: Synthetic Minority over-Sampling Technique10.1613/jair.953 ↗
36. He, H., Bai, Y., Garcia, E., and Li, S. (2008, January 1–8). ADASYN: Adaptive Synthetic Sampling Approach for Imbalanced Learning. In Proceeding of the IEEE International Joint Conference on Neural Networks, Hong Kong, China.
37. Borderline Over-Sampling for Imbalanced Data Classification10.1504/IJKESDP.2011.039875 ↗
38. On Over-Fitting in Model Selection and Subsequent Selection Bias in Performance Evaluation
39. Dattagupta, S.J., and Jayanta Dattagupta, S. (2018). A Performance Comparison of Oversampling Methods for Data Generation in Imbalanced Learning Tasks. [Ph.D. Thesis, NOVA IMS—Information Management School].
40. Towards an Automatic Early Stress Recognition System for Office Environments Based on Multimodal Measurements: A Review10.1016/j.jbi.2015.11.007 ↗
41. Hovsepian, K., Al’Absi, M., Ertin, E., Kamarck, T., Nakajima, M., and Kumar, S. (2015, January 7–11). cStress: Towards a Gold Standard for Continuous Stress Assessment in the Mobile Environment. Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Osaka, Japan.10.1145/2750858.2807526 ↗
42. Keep the Stress Away with SoDA: Stress Detection and Alleviation System10.1109/TMSCS.2017.2703613 ↗
43. Sandulescu, V., Andrews, S., Ellis, D., Bellotto, N., and Mozos, O.M. (2015, January 1–5). Stress Detection Using Wearable Physiological Sensors. Proceedings of the International Work-Conference on the Interplay Between Natural and Artificial Computation, IWINAC 2015, Elche, Spain.10.1007/978-3-319-18914-7_55 ↗