Optimizing Driver Vigilance Recognition: Examining the Characterization and Cumulative Effect of Physiological Signals Across Manual and Automated Driving and Durations
Source abstract
Abstract
Identifying changes in driver’s vigilance under combined manual and automated driving conditions, as well as during prolonged driving, is crucial for reducing car crashes. Existing studies have not adequately considered the similarities and differences in physiological signals between different driving modes or the cumulative effects during extended driving periods. To address this gap, our study focuses on enhancing the feature selection method for driver’s vigilance recognition. A long-duration simulated car-following driving experiment was designed and conducted to simultaneously collect EEG, eye movement, EOG, and driving data. Similarities and differences in the physiological signals of vigilance between manual and automated driving are analyzed in terms of correlation and significance. The cumulative effects of physiological signals are investigated using time series analysis. The proposed feature selection method was validated using an LSTM-based driver’s vigilance recognition model. Results showed a recognition accuracy of 86.32% for manual driving, with a fluctuation rate of 1.18% over prolonged periods. For automated driving, the accuracy was 87.12%, with a fluctuation rate of 0.66%. By considering the similarities and differences in physiological signals between manual and automated driving modes and the cumulative effects, our study enhances the applicability and stability of the driver’s vigilance recognition model across different driving conditions. The validation results demonstrate that the proposed method improves the applicability and stability of the driver’s vigilance recognition model across different driving modes during extended driving periods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Human-Automation Interaction and Safety · Safety Warnings and Signage · Sleep and Work-Related Fatigue
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Engineering, China Agricultural University, Beijing 100083, China
College of Design and Innovation, Tongji University, Shanghai 200092, China
Funding
Military Scientific Research Program Project
References (54)
Show source-provided references
1. Safety of autonomous vehicles10.1155/2020/8867757 ↗
2. Driver vigilance level detection systems: A literature survey
3. Vigilance, monitoring, and search
4. Zhang, K., and Sun, X. (2014). Engineering Psychology and Human Performance, China Machine Press. [4th ed.].
5. Systems with Human Monitors: A Signal Detection Analysis10.1207/s15327051hci0101_2 ↗
6. Driver fatigue: The importance of identifying causal factors of fatigue when considering detection and countermeasure technologies10.1016/j.trf.2008.11.005 ↗
7. A systematic review on detection and prediction of driver drowsiness
8. Vigilance decrement and passive fatigue caused by monotony in automated driving10.1016/j.promfg.2015.07.499 ↗
9. Multiple resources and mental workload10.1518/001872008X288394 ↗
10. Multiple resources and performance prediction10.1080/14639220210123806 ↗
11. The rate of gain of perceived workload in sustained attention10.1518/107118193784162371 ↗
12. Impact of three task demand factors on simulated unmanned system intelligence, surveillance, and reconnaissance operations10.1080/00140139.2016.1216171 ↗
13. MacPhee, M., Dahinten, V.S., and Havaei, F. (2017). The impact of heavy perceived nurse workloads on patient and nurse outcomes. Adm. Sci., 7.10.3390/admsci7010007 ↗
14. Driver vigilance in automated vehicles: Hazard detection failures are a matter of time10.1177/0018720818761711 ↗
15. Driver Sleepiness Classification Based on Physiological Data and Driving Performance from Real Road Driving
16. Stojmenova, K., and Sodnik, J. (2018). Detection-Response Task—Uses and Limitations. Sensors, 18.10.3390/s18020594 ↗
17. Detection of Driver Vigilance Level Using EEG Signals and Driving Contexts10.1109/TR.2017.2778754 ↗
18. Lapse in alertness: Coherence of fluctuations in performance and EEG spectrum10.1016/0013-4694(93)90064-3 ↗
19. Driver Drowsiness Warning system using visual information for both diurnal and nocturnal illumination conditions10.1155/2010/438205 ↗
20. Li, N., and Busso, C. (2013, January 15–19). Analysis of facial features of drivers under cognitive and visual distractions. Proceedings of the 2013 IEEE International Conference on Multimedia and Expo (ICME), San Jose, CA, USA.10.1109/ICME.2013.6607575 ↗
21. Head Pose Estimation and Augmented Reality Tracking: An Integrated System and Evaluation for Monitoring Driver Awareness10.1109/TITS.2010.2044241 ↗
22. Hu, J., Liu, F., and Wang, P. (2019, January 14–17). EEG-Based Multiple Entropy Analysis for Assessing Driver Fatigue. Proceedings of the 2019 5th International Conference on Transportation Information and Safety (ICTIS), Liverpool, UK.10.1109/ICTIS.2019.8883591 ↗
23. Hyder, G., Chowdhry, B.S., Memon, K., and Ahmed, A. (2020, January 6–8). The Smart Automobile (SAM): An Application Based on Drowsiness Detection, Alcohol Detection, Vital Sign Monitoring and Lane based Auto Drive to avoid Accidents. Proceedings of the 2020 Global Conference on Wireless and Optical Technologies, Malaga, Spain.10.1109/GCWOT49901.2020.9391617 ↗
24. Jimenez, I.a.C., Olivetti, E.C., Vezzetti, E., Moos, S., Celeghin, A., and Marcolin, F. (2024). Effective affective EEG-based indicators in emotion-evoking VR environments: An evidence from machine learning. Neural Comput. Appl., 1–19.
25. Cognitive and emotional engagement while learning with VR: The perspective of multimodal methodology10.1016/j.compedu.2022.104495 ↗
26. Classification of pilots’ mental states using a multimodal deep learning network10.1016/j.bbe.2019.12.002 ↗
27. Comprehensive driver behaviour review: Taxonomy, issues and challenges, motivations and research direction towards achieving a smart transportation environment10.1016/j.engappai.2022.104745 ↗
28. Driving behavior recognition using EEG data from a simulated car-following experiment10.1016/j.aap.2017.11.010 ↗
29. Should Manual Driving be (Eventually) Outlawed?10.1007/s11948-020-00190-9 ↗
30. Self-driving cars and the right to drive10.1007/s13347-022-00551-1 ↗
31. Highly Automated Driving, Secondary Task Performance, and Driver State10.1177/0018720812442087 ↗
32. Real autonomous driving from a passenger’s perspective: Two experimental investigations using gaze behaviour and trust ratings in field and simulator10.1016/j.trf.2019.08.013 ↗
33. Yang, H., Shi, L., Liu, F., Zhang, Y., Liu, B., Li, Y., Shi, Z., and Zhou, S. (2017). EEG and ECG changes during deep-sea manned submersible operation. arXiv.
34. Vibrotactile temporal summation: Probability summation or neural integration?10.1080/08990229970483 ↗
35. Individual Susceptibility to Vigilance Decrement in Prolonged Assisted Driving Revealed by Alert-State Wearable EEG Assessment10.1109/TCDS.2022.3231691 ↗
36. Estimating alertness from the EEG power spectrum10.1109/10.553713 ↗
37. Angell, L.S., Auflick, J., Austria, P.A., Kochhar, D.S., and Kiger, S. (2006). Driver Workload Metrics Task 2 Final Report.10.1037/e729342011-001 ↗
38. Analysis of Electroencephalography (EEG) Signals and its Categorization–A Study10.1016/j.proeng.2012.06.298 ↗
39. Driving Safety Performance Assessment Metrics for ADS-Equipped Vehicles10.4271/2020-01-1206 ↗
40. Driver Fatigue Classification with Independent Component by Entropy Rate Bound Minimization Analysis in an EEG-Based System10.1109/JBHI.2016.2532354 ↗
41. A hybrid approach for driver drowsiness detection utilizing practical data to improve performance system and applicability10.3233/WOR-230179 ↗
42. Predicting driver takeover performance in conditionally automated driving10.1016/j.aap.2020.105748 ↗
43. Lovie, P. (2005). Coefficient of variation. Encyclopedia of Statistics in Behavioral Science, Wiley.10.1002/0470013192.bsa107 ↗
44. Functional time series model identification and diagnosis by means of auto- and partial autocorrelation analysis10.1016/j.csda.2020.107108 ↗
45. Theta power as a marker for cognitive interference10.1016/j.clinph.2011.03.030 ↗
46. Regional brain wave activity changes associated with fatigue10.1111/j.1469-8986.2011.01329.x ↗
47. Alpha/beta power decreases track the fidelity of stimulus-specific information10.7554/eLife.49562 ↗
48. Neural and psychophysiological correlates of human performance under stress and high mental workload10.1016/j.biopsycho.2016.10.002 ↗
49. Effect of magnitopuncture on sympathetic and parasympathetic nerve activities in healthy drivers—Assessment by power spectrum analysis of heart rate variability10.1007/s00421-002-0747-5 ↗
50. On the Roles of Eye Gaze and Head Dynamics in Predicting Driver’s Intent to Change Lanes10.1109/TITS.2009.2026675 ↗
51. Commercial motor vehicle driving performance: An examination of attentional resources and control using a driving simulator10.1037/xap0000120 ↗
52. Effects of mental workload on physiological and subjective responses during traffic density monitoring: A field study10.1016/j.apergo.2015.07.009 ↗
53. Billman, G.E. (2013). The effect of heart rate on the heart rate variability response to autonomic interventions. Front. Physiol.10.3389/fphys.2013.00222 ↗
54. Individual differences in diving10.1016/j.paid.2013.07.252 ↗