Framework, Implementation, and User Experience Aspects of Driver Monitoring: A Systematic Review
Source abstract
Abstract
Driver monitoring systems (DMS), advanced driver assistance ssystems (ADAs), and technologies for autonomous driving, along with other upcoming innovations, have been developed as possible solutions to minimize accidents resulting from human error. This paper presents a thorough review of DMSs and user experience (UX). The objective is to investigate, combine, and evaluate the key elements involved in the development and application of DMSs, as well as the UX factors relevant to the current landscape of the field, serving as a reference for future investigations. The review encompasses a bibliographic analysis performed at different stages, offering valuable insights into the evolution of the topic. It examines the processes of development and implementation of driver monitoring systems. Furthermore, this work facilitates future research by consolidating and presenting a valuable collection of identified datasets, both public and private, for various research purposes. From this evaluation, critical components for DMSs can be identified, establishing a foundation for future research by providing a framework for the adoption and integration of these systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Human-Automation Interaction and Safety · Autonomous Vehicle Technology and Safety · Traffic and Road Safety
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Tecnologico de Monterrey, School of Engineering and Sciences, Periferico Sur 6666, AMSA, Tlalpan, Mexico City 14380, Mexico
Funding
Instituto Tecnológico y de Estudios Superiores de Monterrey Escuela de Ingeniería and Secretaría de Ciencia, Humanidades, Tecnología e Innovación
References (100+)
Show source-provided references
1. Instituto Nacional de Estadística y Geografía (INEGI) (2016). Síntesis Metodológica de la Estadística de Accidentes de Tránsito Terrestre en Zonas Urbanas y Suburbanas 2016, INEGI. Available online: https://en.www.inegi.org.mx/contenidos/productos/prod_serv/contenidos/espanol/bvinegi/productos/nueva_estruc/702825087999.pdf.
2. Singh, S. (2025, October 06). Critical Reasons for Crashes Investigated in the National Motor Vehicle Crash Causation Survey, Available online: https://crashstats.nhtsa.dot.gov/Api/Public/ViewPublication/812506.
3. Davoli, L., Martalò, M., Cilfone, A., Belli, L., Ferrari, G., Presta, R., Montanari, R., Mengoni, M., Giraldi, L., and Amparore, E.G. (2020). On Driver Behavior Recognition for Increased Safety: A Roadmap. Safety, 6.10.3390/safety6040055 ↗
4. Modelling of operators’ emotion and task performance in a virtual driving environment10.1016/j.ijhcs.2011.05.003 ↗
5. Training benefits driver behaviour while using automation with an attention monitoring system10.1016/j.trc.2024.104752 ↗
6. National Highway Traffic Safety Administration (2025, October 06). Summary Report: Standing General Order on Crash Reporting for Level 2 Advanced Driver Assistance Systems, Available online: https://www.nhtsa.gov/sites/nhtsa.gov/files/2022-06/ADAS-L2-SGO-Report-June-2022.pdf.
7. Usability testing of three visual HMIs for assisted driving: How design impacts driver distraction and mental models10.1080/00140139.2022.2136766 ↗
8. Yager, C., Dinakar, S., Sanagaram, M., and Ferris, T.K. (2015). Emergency Vehicle Operator On-Board Device Distractions, Texas A&M University. Technical Report.
9. Impacts of Advanced Vehicle Technologies and Risk Attitudes on Distracted Driving Behaviors10.1177/03611981241242079 ↗
10. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews10.1016/j.jclinepi.2021.03.001 ↗
11. SCImago Graphica: A new tool for exploring and visually communicating data
12. van Eck, N.J., and Waltman, L. (2023). VOSviewer, Version 1.6.20, Software Tool for Constructing and Visualizing Bibliometric Networks, Centre for Science and Technology Studies (CWTS), Leiden University. Available online: https://www.vosviewer.com.
13. Braun, M., Chadowitz, R., and Alt, F. (2019). User Experience of Driver State Visualizations: A Look at Demographics and Personalities. Human-Computer Interaction—INTERACT 2019 (Lecture Notes in Computer Science, Vol. 11749), Proceedings of the INTERACT 2019, Paphos, Cyprus, 2–6 September 2019, Springer.10.1007/978-3-030-29390-1_9 ↗
14. Krüger, S., Bosch, E., Ihme, K., and Oehl, M. (2021). In-Vehicle Frustration Mitigation via Voice-User Interfaces—A Simulator Study. HCI International 2021—Posters (Communications in Computer and Information Science, Volume 1421), Springer.10.1007/978-3-030-78645-8_30 ↗
15. A Human-Vehicle Collaborative Driving Framework for Driver Assistance10.1109/TITS.2018.2878027 ↗
16. Adaptive Visual Assistance System for Enhancing the Driver Awareness of Pedestrians
17. European NCAP Driver State Monitoring Protocols: Prevalence of Distraction in Naturalistic Driving10.1177/00187208231194543 ↗
18. Quiles-Cucarella, E., Cano-Bernet, J., Santos-Fernández, L., Roldán-Blay, C., and Roldán-Porta, C. (2024). Multi-Index Driver Drowsiness Detection Method Based on Driver’s Facial Recognition Using Haar Features and Histograms of Oriented Gradients. Sensors, 24.10.3390/s24175683 ↗
19. Linschmann, O., Uguz, D.U., Romanski, B., Baarlink, I., Gunaratne, P., Leonhardt, S., Walter, M., and Lueken, M. (2023). A Portable Multi-Modal Cushion for Continuous Monitoring of a Driver’s Vital Signs. Sensors, 23.10.3390/s23084002 ↗
20. Amidei, A., Rapa, P.M., Tagliavini, G., Rabbeni, R., Pavan, P., and Benatti, S. (2023, January 8–9). ANGELS—Smart Steering Wheel for Driver Safety. Proceedings of the 2023 9th International Workshop on Advances in Sensors and Interfaces (IWASI), Monopoli (Bari), Italy.10.1109/IWASI58316.2023.10164505 ↗
21. Bhagat, A., Kale, J.G., Pachhapurkar, N., Karle, M., and Karle, U. (2024). Development & Testing of a Camera-Based Driver Monitoring System, SAE International. SAE Technical Paper 2024-26-0028.10.4271/2024-26-0028 ↗
22. Trip characteristics impact on the frequency of harsh events recorded via smartphone sensors10.1016/j.iatssr.2021.07.004 ↗
23. González-Ortega, D., Díaz-Pernas, F.J., Martínez-Zarzuela, M., and Antón-Rodríguez, M. (2019). A Physiological Sensor-Based Android Application Synchronized with a Driving Simulator for Driver Monitoring. Sensors, 19.10.3390/s19020399 ↗
24. González-Ortega, D., Díaz-Pernas, F.J., Martínez-Zarzuela, M., and Antón-Rodríguez, M. (2020). Comparative Analysis of Kinect-Based and Oculus-Based Gaze Region Estimation Methods in a Driving Simulator. Sensors, 21.10.3390/s21010026 ↗
25. Feasibility of smart wearables for driver drowsiness detection and its potential among different age groups10.1108/IJPCC-03-2019-0017 ↗
26. Rezaee, Q., Delrobaei, M., Giveki, A., Dayarian, N., and Haghighi, S.J. (2022, January 22–24). Driver Drowsiness Detection with Commercial EEG Headsets. Proceedings of the 2022 10th RSI International Conference on Robotics and Mechatronics (ICRoM), Tehran, Iran.10.1109/ICRoM57054.2022.10025070 ↗
27. Nilsson, E.J., Bärgman, J., Aust, M.L., Matthews, G., and Svanberg, B. (2022). Let complexity bring clarity: A multidimensional assessment of cognitive load using physiological measures. Front. Neuroergonomics, 3.10.3389/fnrgo.2022.787295 ↗
28. Multi-modal user experience evaluation on in-vehicle HMI systems using eye-tracking, facial expression, and finger-tracking for the smart cockpit10.1504/IJVP.2022.125931 ↗
29. Do driver monitoring technologies improve the driving behaviour of distracted drivers? A simulation study to assess the impact of an auditory driver distraction warning device on driving performance10.1016/j.trf.2023.04.013 ↗
30. Head Tracking in Automotive Environments for Driver Monitoring Using a Low Resolution Thermal Camera10.3390/vehicles4010014 ↗
31. Real-Time Safety Driving Advisory System Utilizing a Vision-Based Driving Monitoring Sensor10.1587/transinf.2023EDL8077 ↗
32. Koniakowsky, I.M., Forster, Y., Naujoks, F., Krems, J.F., and Keinath, A. (2023, January 18–22). How Do Automation Modes Influence the Frequency of Advanced Driver Distraction Warnings? A Simulator Study. Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Ingolstadt, Germany.10.1145/3581961.3609888 ↗
33. Continuous monitoring of visual distraction and drowsiness in shift-workers during naturalistic driving10.1016/j.ssci.2018.11.007 ↗
34. Assunção, A.N., Aquino, A.L.L., and Câmara de, M. (2019). Santos, R.C.; Guimarães, R.L.M.; Oliveira, R.A.R. Vehicle driver monitoring through the statistical process control. Sensors, 19.10.3390/s19143059 ↗
35. Gaussian Process-Based Personalized Adaptive Cruise Control10.1109/TITS.2022.3174042 ↗
36. Safety assessment of trucks based on GPS and in-vehicle monitoring data10.1016/j.aap.2022.106619 ↗
37. Yoshihara, Y., Tanaka, T., Osuga, S., Fujikake, K., Karatas, N., and Kanamori, H. (November, January 19). Identifying High-Risk Older Drivers by Head-Movement Monitoring Using a Commercial Driver Monitoring Camera. Proceedings of the 2020 IEEE Intelligent Vehicles Symposium (IV), Las Vegas, NV, USA.10.1109/IV47402.2020.9304700 ↗
38. A comprehensive review of approaches to detect fatigue using machine learning techniques
39. Exploiting Blood Volume Pulse and Skin Conductance for Driver Drowsiness Detection10.1007/978-3-031-28663-6_5 ↗
40. Machine learning based driver monitoring system: A case study for the Kayoola EVS10.23919/SAIEE.2023.10071976 ↗
41. Designing in-car emotion-aware automation
42. Personalized EV Driving Sound Design Based on the Driver’s Total Emotion Recognition10.4271/2022-01-0972 ↗
43. Towards real-time monitoring of fear in driving sessions10.1016/j.ifacol.2019.12.068 ↗
44. Antona, M., and Stephanidis, C. (2020). A preliminary investigation towards the application of facial expression analysis to enable an emotion-aware car interface. Universal Access in Human-Computer Interaction—Applications and Practice: 14th International Conference, UAHCI 2020, Part II (Lecture Notes in Computer Science, Volume 12213), Springer.
45. Generosi, A., Bruschi, V., Cecchi, S., Dourou, N.A., Montanari, R., and Mengoni, M. (2024, January 26–28). An Innovative System for Driver Monitoring and Vehicle Sound Interaction. Proceedings of the 2024 IEEE International Workshop on Metrology for Automotive (MetroAutomotive), Bologna, Italy.10.1109/MetroAutomotive61329.2024.10615427 ↗
46. Spencer, C., Koç, İ.A., Suga, C., Lee, A., Dhareshwar, A.M., Franzén, E., Iozzo, M., Morrison, G., and McKeown, G. (2020, January 21–22). Assessing the Use of Physiological Signals and Facial Behaviour to Gauge Drivers’ Emotions as a UX Metric in Automotive User Studies. Proceedings of the 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’20 Adjunct), Virtual Event.10.1145/3409251.3411728 ↗
47. Attentional warnings caused by driver monitoring systems: How often do they appear and how well are they understood?10.1016/j.aap.2024.107684 ↗
48. Methodology and Mobile Application for Driver Behavior Analysis and Accident Prevention10.1109/TITS.2019.2918328 ↗
49. Comparative Analysis of Vehicle-Based and Driver-Based Features for Driver Drowsiness Monitoring by Support Vector Machines10.1109/TITS.2022.3207965 ↗
50. Evaluation of driver drowsiness using respiration analysis by thermal imaging on a driving simulator10.1007/s11042-020-08696-x ↗
51. The detection of drowsiness using a driver monitoring system10.1080/15389588.2019.1622005 ↗
52. Multi-sensor driver monitoring for drowsiness prediction10.1080/15389588.2023.2164839 ↗
53. Fast Detection and Classification of Drivers’ Responses to Stressful Events and Cognitive Workload10.1007/978-3-031-06388-6_28 ↗
54. On-to-off-path gaze shift cancellations lead to gaze concentration in cognitively loaded car drivers: A simulator study exploring gaze patterns in relation to a cognitive task and the traffic environment10.1016/j.trf.2020.09.013 ↗
55. Benusa, M., and Min, C.-H. (2024, January 11–14). Wearable Driver Monitoring System. Proceedings of the 2024 IEEE 67th International Midwest Symposium on Circuits and Systems (MWSCAS), Springfield, MA, USA.10.1109/MWSCAS60917.2024.10658722 ↗
56. A Brain Wave-Verified Driver Alert System for Vehicle Collision Avoidance10.4271/09-09-01-0002 ↗
57. Silent failure detection in partial automation as a function of visual attentiveness10.1080/15389588.2022.2151308 ↗
58. Reducing risky driving: Assessing the impacts of an automatically assigned, targeted web-based instruction program10.1016/j.jsr.2019.06.006 ↗
59. Ulrich, K., and Eppinger, S. (2015). Product Design and Development, McGraw-Hill Education.
60. Dieter, G.E., and Schmidt, L.C. (2020). Engineering Design, McGraw-Hill Higher Education. [6th ed.].
61. Proposal of a Methodology for Mechatronic Design From Ideation to Embodiment Design: Application in a Masonry Robot Case Study Design10.1109/ACCESS.2025.3595509 ↗
62. Nudging the safe zone: Design and assessment of HMI strategies based on intelligent driver state monitoring systems10.1007/978-3-031-35678-0_10 ↗
63. Evaluation of Driver Reaction to Disengagement of Advanced Driver Assistance System with Different Warning Systems While Driving Under Various Distractions10.1177/03611981241252789 ↗
64. A gaze-based driver distraction countermeasure: Comparing effects of multimodal alerts on driver’s behavior and visual attention
65. Adverse Behavioral Adaptation to Adaptive Forward Collision Warning Systems: An Investigation of Primary and Secondary Task Performance10.1016/j.aap.2020.105718 ↗
66. Okazaki, S., Haramaki, T., and Nishino, H. (2018). A safe driving support method using olfactory stimuli. Complex, Intelligent, and Software Intensive Systems. CISIS 2018. Advances in Intelligent Systems and Computing, Springer.10.1007/978-3-319-93659-8_89 ↗
67. Bringing a Vehicle to a Controlled Stop: Effectiveness of a Dual-Control Scheme for Identifying Driver Drowsiness and Executing Safety Control under Hands-off Partial Driving Automation10.1016/j.ifacol.2023.10.1024 ↗
68. Effect of time length of eye movement data analysis on the accuracy of mental workload estimation during automobile driving
69. Nair, V.V., Rehmann, M., de la Rosa, S., and Curio, C. (2024, January 2–5). Investigating Drivers’ Awareness of Pedestrians Using Virtual Reality towards Modeling the Impact of External Factors. Proceedings of the 2024 IEEE Intelligent Vehicles Symposium (IV), Jeju Island, Republic of Korea.10.1109/IV55156.2024.10588734 ↗
70. Cvetković, M.M., Soares, D., and Baptista, J.S. (2021). Assessing post-driving discomfort and its influence on gait patterns. Sensors, 21.10.3390/s21248492 ↗
71. Dangerous State Detection in Vehicle Cabin Based on Audiovisual Analysis with Smartphone Sensors
72. Impact of Lane Keeping Assist System Camera Misalignment on Driver Behavior10.1080/15472450.2020.1822174 ↗
73. Krstačić, R., Žužić, A., and Orehovački, T. (2024). Safety Aspects of In-Vehicle Infotainment Systems: A Systematic Literature Review from 2012 to 2023. Electronics, 13.10.3390/electronics13132563 ↗
74. Engström, J., Monk, C.A., Hanowski, R.J., Horrey, W.J., Lee, J.D., McGehee, D.V., Regan, M., Stevens, A., Traube, E., and Tuukkanen, M. (2013). A Conceptual Framework and Taxonomy for Understanding and Categorizing Driver Inattention. Available online: https://iro.uiowa.edu/esploro/outputs/report/A-conceptual-framework-and-taxonomy-for/9984186943902771.
75. Driver distraction and driver inattention: Definition, relationship and taxonomy10.1016/j.aap.2011.04.008 ↗
76. SAE International (2025, October 06). Operational Definitions of Driving Performance Measures and Statistics, SAE Standard J2944_202302 (Recommended Practice). Available online: https://saemobilus.sae.org/standards/j2944_202302-operational-definitions-driving-performance-measures-statistics.
77. European New Car Assessment Programme (Euro NCAP) (2025, October 06). Assessment Protocol—Safety Assist: Safe Driving, Version 10.1; Implementation 2023. July 2022. Available online: https://cdn.euroncap.com/media/70315/euro-ncap-assessment-protocol-sa-safe-driving-v101.pdf.
78. Marafie, Z., Lin, K.-J., Wang, D., Lyu, H., Liu, Y., Meng, Y., and Ma, J. (2021). AutoCoach: An Intelligent Driver Behavior Feedback Agent with Personality-Based Driver Models. Electronics, 10.10.3390/electronics10111361 ↗
79. 3MDAD: A novel public dataset for multimodal multiview and multispectral driver distraction analysis10.1016/j.image.2020.115960 ↗
80. (2024, December 15). Driver Drowsiness Using Keras | Kaggle. Available online: https://www.kaggle.com/code/adinishad/driver-drowsiness-using-keras/comments.
81. Road Rage and Aggressive Driving Behaviour Detection in Usage-Based Insurance Using Machine Learning10.4018/IJSI.319314 ↗
82. GIDAS–German In-Depth Accident Study, Verkehrsunfallforschung an der TU Dresden GmbH (VUFO). Available online: https://www.gidas.org/start-en.html.
83. Ydenius, A., Stigson, H., Kullgren, A., and Sunnevång, C. (2013, January 27–30). Accuracy of Folksam Electronic Crash Recorder (ECR) in Frontal and Side Impact Crashes. Proceedings of the 23rd International Technical Conference on the Enhanced Safety of Vehicles (ESV), Seoul, Republic of Korea.
84. Berri, R., and Osório, F. A 3D vision system for detecting use of mobile phones while driving. Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil.10.1109/IJCNN.2018.8489093 ↗
85. Bin Rozaimi, I.D., Zaman, F.H.K., Abdullah, S.A.C., Abidin, H.Z., and Mazalan, L. Driver Drowsiness Detection Using Deep Learning Models Based On Different Camera Positions. Proceedings of the 2023 11th International Conference on Information and Communication Technology (ICoICT), Melaka, Malaysia.10.1109/ICoICT58202.2023.10262759 ↗
86. (2025, July 23). Data Castle. Chengdu Taxi GPS Data. Pkbigdata. Available online: https://www.pkbigdata.com/common/zhzgbCmptDataDetails.html#down.
87. Dahl, J., Campos, G.R.D., and Fredriksson, J. (2023, January 4–7). Intention-Aware lane keeping assist using driver gaze information. Proceedings of the 2022 IEEE Intelligent Vehicles Symposium (IV), Anchorage, AK, USA.10.1109/IV55152.2023.10186601 ↗
88. Doniec, R., Konior, J., Sieciński, S., Piet, A., Irshad, M.T., Piaseczna, N., Hasan, M.A., Li, F., Nisar, M.A., and Grzegorzek, M. (2023). Sensor-Based classification of primary and secondary car driver activities using convolutional neural networks. Sensors, 23.10.20944/preprints202304.1061.v1 ↗
89. Dreißig, M., Baccour, M.H., Schäck, T., and Kasneci, E. (2020, January 1–4). Driver Drowsiness Classification Based on Eye Blink and Head Movement Features Using the k-NN Algorithm. Proceedings of the 2020 IEEE Symposium Series on Computational Intelligence (SSCI), Canberra, Australia.10.1109/SSCI47803.2020.9308133 ↗
90. Computer Vision Lab, National Tsuing Hua University (2025, July 23). Driver Drowsiness Detection Dataset. Available online: https://www.kaggle.com/datasets/ismailnasri20/driver-drowsiness-dataset-ddd.
91. Using real-life alert-based data to analyse drowsiness and distraction of commercial drivers10.1016/j.trf.2018.10.003 ↗
92. Fusek, R., Sojka, E., Gaura, J., and Halman, J. (2022). Driver State Detection from In-Car Camera Images. Advances in Visual Computing. ISVC 2022. Lecture Notes in Computer Science, Springer.10.1007/978-3-031-20716-7_24 ↗
93. (2025, July 23). State Farm. State Farm Distracted Driver Detection. Kaggle. Available online: https://www.kaggle.com/c/state-farm-distracted-driver-detection/overview.
94. Gwak, J., Hirao, A., and Shino, M. (2020). An investigation of early detection of driver drowsiness using ensemble machine learning based on hybrid sensing. Appl. Sci., 10.10.3390/app10082890 ↗
95. Hedi Baccour, M., Driewer, F., Schäck, T., and Kasneci, E. (2020, January 11–14). Camera-based Driver Drowsiness State Classification Using Logistic Regression Models. Proceedings of the 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Toronto, ON, Canada.10.1109/SMC42975.2020.9282918 ↗
96. Exploratory development of algorithms for determining driver attention status10.1177/00187208231198932 ↗
97. Hollósi, J., Ballagi, Á., Kovács, G., Fischer, S., and Nagy, V. (2024). Bus Driver Head Position Detection Using Capsule Networks under Dynamic Driving Conditions. Computers, 13.10.3390/computers13030066 ↗
98. Zhu, X., Lei, Z., Liu, X., Shi, H., and Li, S.Z. (2016, January 27–30). Face Alignment Across Large Poses: A 3D Solution. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.23 ↗
99. ETH Zurich Computer Vision Lab (2025, July 23). Head Pose Image Database. Available online: https://data.vision.ee.ethz.ch/cvl/vision2/datasets/headposeCVPR08.
100. Zhang, X., Sugano, Y., Fritz, M., and Bulling, A. (2025, July 23). MPIIGaze: Real-World Dataset for Appearance-Based Gaze Estimation. Max Planck Institute for Informatics. Available online: https://www.mpi-inf.mpg.de/departments/computer-vision-and-machine-learning/research/gaze-based-human-computer-interaction/appearance-based-gaze-estimation-in-the-wild.