journal article·2026-03-10Open access

Exploring the Impact of Emotional States on Fatigue Evolution in Metro Drivers: A Physiological Signal-Based Approach

Lianjie Chen, Yuanchun Huang, Fangsheng Wang, Lin Zhu, Zhigang Liu

Applied Sciences· Volume 16· Issue 6

Abstract

To investigate the regulatory effects of emotional states on the evolution of fatigue in metro drivers, this study conducts an experimental investigation based on an urban rail transit driving simulation platform. A total of 21 participants complete a 90 min simulated driving task, during which electroencephalogram (EEG) and electrocardiogram (ECG) signals are synchronously collected from drivers for fatigue assessment and emotion recognition, respectively. An emotion recognition model based on a multi-scale convolutional neural network (MSCNN) combined with an attention mechanism is constructed. The proposed model uses ECG signals to classify three emotional states—neutral, positive, and negative—where the neutral state is defined as an emotionally undefined baseline that is neither positive nor negative. The model achieves a classification accuracy of 86.96% on the DREAMER dataset. By temporally aligning the emotion recognition results with EEG frequency-domain fatigue indicators, the results show that fatigue exhibits the highest growth and largest fluctuation in amplitude under negative emotions, demonstrating a pronounced fatigue-accelerating effect. Under positive emotions, fatigue decreases considerably and has smaller fluctuations, indicating a certain buffering and restorative effect. In contrast, the neutral emotional state exhibits intermediate and transitional fatigue characteristics. This study innovatively integrates ECG-based emotion recognition with EEG-based fatigue assessment to reveal the mechanisms based on which emotions influence fatigue in metro driving tasks from a physiological perspective. This work provides a basis for emotion-aware fatigue monitoring and safety intervention strategies.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Sleep and Work-Related Fatigue · Emotion and Mood Recognition · Heart Rate Variability and Autonomic Control

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Urban Railway Transportation, Shanghai University of Engineering Science, Songjiang Campus, No. 333 Longteng Road, Songjiang District, Shanghai 201620, China

Funding

A data–event fusion-driven method for metro operation risk prevention and control under extreme weather scenarios.

References (25)

Show source-provided references
1. Understanding the human factors contribution to railway accidents and incidents in Australia10.1016/j.aap.2008.06.013 ↗
2. Lees, T., Chalmers, T., Burton, D., Zilberg, E., Penzel, T., and Lal, S. (2023). Psychophysiology of Monotonous Driving, Fatigue and Sleepiness in Train and Non-Professional Drivers: Driver Safety Implications. Behav. Sci., 13.10.3390/bs13100788 ↗
3. Improving driving safety by detecting negative emotions with biological signals: Which is the best?10.1177/03611981211041594 ↗
4. Gartenberg, D., Gunzelmann, G., Hassanzadeh-Behbaha, S., and Trafton, J.G. (2018). Examining the Role of Task Requirements in the Magnitude of the Vigilance Decrement. Front. Psychol., 9.10.3389/fpsyg.2018.01504 ↗
5. Xi, J., Wang, S., Ding, T., Tian, J., Shao, H., and Miao, X. (2021). Detection Model on Fatigue Driving Behaviors Based on the Operating Parameters of Freight Vehicles. Appl. Sci., 11.10.3390/app11157132 ↗
6. Lamas, D., Loizides, F., Nacke, L., Petrie, H., Winckler, M., and Zaphiris, P. (2019). Detecting and influencing driver emotions using psycho-physiological sensors and ambient light. Human-Computer Interaction—INTERACT 2019, Springer.10.1007/978-3-030-29390-1 ↗
7. Mekki, O., Dupuis, P., Hbaieb, C.G., Canale, L., Zissis, G., and Cheikhrouhou, M. (2022). Light quality, color perception and emotions in the interior space. Proceedings of the 2021 Joint Conference—11th International Conference on Energy Efficiency in Domestic Appliances and Lighting & 17th International Symposium on the Science and Technology of Lighting (EEDAL/LS:17), Toulouse, France, 1-3 June 2022, IEEE.
8. Transport and emotion: How neurosciences could open a new research field10.1016/j.tbs.2020.02.001 ↗
9. Arousal, valence, and discrete categories in facial emotion10.1038/s41598-025-24032-5 ↗
10. The analysis of driver behavioral tendency under different emotional states based on a Bayesian network10.1109/TAFFC.2020.3027720 ↗
11. Driver emotion recognition for intelligent vehicles: A survey
12. A review for the driving behavior recognition methods based on vehicle multisensor information10.1155/2022/7287511 ↗
13. Xiao, H., Li, W., Zeng, G., Wu, Y., Xue, J., Zhang, J., Li, C., and Guo, G. (2022). On-Road Driver Emotion Recognition Using Facial Expression. Appl. Sci., 12.10.3390/app12020807 ↗
14. A multi-modal driver emotion dataset and study: Including facial expressions and synchronized physiological signals10.1016/j.engappai.2023.107772 ↗
15. Wang, L., Hao, J., and Zhou, T.H. (2023). ECG Multi-Emotion Recognition Based on Heart Rate Variability Signal Features Mining. Sensors, 23.10.3390/s23208636 ↗
16. Effect of circadian rhythms and driving duration on fatigue level and driving performance of professional drivers10.3141/2402-03 ↗
17. Sun, C., and Mou, C. (2023). Survey on the research direction of EEG-based signal processing. Front. Neurosci., 17.10.3389/fnins.2023.1203059 ↗
18. Singh, A.K., and Krishnan, S. (2022). Trends in EEG signal feature extraction applications. Front. Artif. Intell., 5.10.3389/frai.2022.1072801 ↗
19. Comparing combinations of EEG activity in train drivers during monotonous driving10.1016/j.eswa.2010.07.109 ↗
20. Local means denoising of ECG signal10.1016/j.bspc.2019.101571 ↗
21. Modeling and recognition of driving fatigue state based on R–R intervals of ECG data10.1109/ACCESS.2019.2956652 ↗
22. Emotion prediction of EEG signals based on 1D convolutional neural network10.1088/1742-6596/2024/1/012044 ↗
23. DREAMER: A database for emotion recognition through EEG and ECG signals from wireless low-cost off-the-shelf devices10.1109/JBHI.2017.2688239 ↗
24. Albalooshi, F.A. (2024). Novel Approach in Vegetation Detection Using Multi-Scale Convolutional Neural Network. Appl. Sci., 14.10.3390/app142210287 ↗
25. Joint modelling of audio-visual cues using attention mechanisms for emotion recognition10.1007/s11042-022-13557-w ↗