journal article·2025-06-17Open access

Dialogue at the Edge of Fatigue: Personalized Voice Assistant Strategies in Intelligent Driving Systems

Chenyi Zhou, Linwei Wang, Yanqun Yang

Applied Sciences· Volume 15· Issue 12

Abstract

With the rapid development of intelligent transportation systems, voice assistants are increasingly integrated into driving environments, providing an effective means to mitigate the risks of fatigued driving. This study explored drivers’ interaction preferences with voice assistants under different fatigue states and proposed a fatigue-state-based dialogue-awakening mechanism. Using Grounded Theory and the Stimulus–Organism–Response (SOR) framework, in-depth interviews were conducted with 25 drivers from diverse occupational backgrounds. To validate the qualitative findings, a driving simulation experiment was carried out to examine the effects of different voice interaction styles on driver fatigue arousal across various fatigue levels. Results indicated that heavily fatigued drivers preferred highly stimulating and interactive voice communication; mildly fatigued drivers tended toward gentle and socially supportive dialogue; while drivers in a non-fatigued state preferred minimal voice interference, activating voice assistance only when necessary. Significant occupational differences were also observed: long-haul truck drivers emphasized practicality and safety in voice assistants, taxi drivers favored voice interactions combining navigation and social content, and private car owners preferred personalized and emotional support. This study enriches the theoretical understanding of fatigue-sensitive voice interactions and provides practical guidance for the adaptive design of intelligent voice assistants, promoting their application in driving safety.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Sleep and Work-Related Fatigue · Human-Automation Interaction and Safety · Transportation and Mobility Innovations

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Civil Engineering, Fuzhou University, Fuzhou 350116, China

References (65)

Show source-provided references
1. Driver fatigue detection systems: A review10.1109/TITS.2018.2868499 ↗
2. A machine learning approach for predicting road accidents
3. Rezaee, K., Khosravi, M.R., Attar, H., and Almatarneh, S. (December, January 29). EEG-based driving fatigue recognition using hybrid deep transfer learning approach. Proceedings of the 2022 International Engineering Conference on Electrical, Energy, and Artificial Intelligence (EICEEAI), Zarqa, Jordan.10.1109/EICEEAI56378.2022.10050453 ↗
4. Comparative analysis of driver fatigue in three companies from different industries10.1016/j.trpro.2023.02.167 ↗
5. Awareness of sleepiness: Temporal dynamics of subjective and objective sleepiness10.1111/psyp.13839 ↗
6. A novel fatigue driving state recognition and warning method based on EEG and EOG signals10.1155/2021/7799793 ↗
7. Fatigue driving detection based on electrooculography: A review10.1186/s13640-021-00575-1 ↗
8. Ahmad, S.K., Agarwal, N., Tanwar, P., and Sundram, S.K. (2024, January 23–24). Driver Drowsiness Detection System Using Image Recognition. Proceedings of the 2024 1st International Conference on Advanced Computing and Emerging Technologies (ACET), Ghaziabad, India.10.1109/ACET61898.2024.10730690 ↗
9. Exploring the Different Patterns for Generation Process of Driving Fatigue Based on Individual Driving Behavior Parameters10.1177/0361198121998351 ↗
10. Lin, N., and Zuo, Y. (2024). Advancing driver fatigue detection in diverse lighting conditions for assisted driving vehicles with enhanced facial recognition technologies. PLoS ONE, 19.10.1371/journal.pone.0304669 ↗
11. Pathan, K.H., and Patil, M.M. (2016, January 16–17). Survey of cooperative advance driver assistance systems. Proceedings of the 2016 International Conference on Control, Instrumentation, Communication and Computational Technologies (ICCICCT), Kumaracoil, India.10.1109/ICCICCT.2016.7987915 ↗
12. Performance on driving-related tasks during music10.1080/001401399185153 ↗
13. Effects of verbal and spatial-imagery tasks on eye fixations while driving10.1037/1076-898X.6.1.31 ↗
14. The impact of vehicle fragrance on driving performance: What do we know?10.1016/j.sbspro.2016.05.173 ↗
15. Doze sleepy driving prevention system (finger massage, high density oxygen spray, grapefruit fragrance) with that involves chewing dried shredded squid10.1016/j.procs.2013.09.161 ↗
16. Effects of peppermint and cinnamon odor administration on simulated driving alertness, mood and workload
17. Improving hazard perception for drivers based on driving styles with visual alerts10.1016/j.trf.2023.07.018 ↗
18. Driver behavior and performances on in-vehicle display based speed compliance10.1016/j.aap.2021.106390 ↗
19. Pilkington-Cheney, F., Afghari, A.P., Filtness, A., Papadimitriou, E., Lourenço, A., and Brijs, T. (2021, January 16–17). The i-DREAMS intervention strategies to reduce driver fatigue and sleepiness for different transport modes. Proceedings of the 2021 7th International Conference on Models and Technologies for Intelligent Transportation Systems (MT-ITS), Heraklion, Greece.10.1109/MT-ITS49943.2021.9529340 ↗
20. Preferences for Single-Turn vs. Multiturn Voice Dialogs in Automotive Use Cases—Results of an Interactive User Survey in Germany10.1109/ACCESS.2022.3174592 ↗
21. Huang, J., Wang, H., Ding, S., and Wang, S. (2022, January 14–18). DuIVA: An intelligent voice assistant for hands-free and eyes-free voice interaction with the Baidu Maps App. Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Washington, DC, USA.10.1145/3534678.3539030 ↗
22. Yang, Y., Zhang, Y., Zhong, Z., Dai, W., Chen, Y., and Chen, M. (2024, January 19–21). Intelligent in-car emotion regulation interaction system based on speech emotion recognition. Proceedings of the 2024 4th International Conference on Computer, Control and Robotics (ICCCR), Shanghai, China.10.1109/ICCCR61138.2024.10585371 ↗
23. Braun, M., Schubert, J., Pfleging, B., and Alt, F. (2019). Improving driver emotions with affective strategies. Multimodal Technol. Interact., 3.10.3390/mti3010021 ↗
24. Zhang, W., and Chen, J. (2023). Future automobile driving space voice interaction: Adapt to the driving scenarios and user personalities. Ergonomics in Design, AHFE International.10.54941/ahfe1003420 ↗
25. Grounded theory research: Procedures, canons, and evaluative criteria10.1007/BF00988593 ↗
26. Understanding the mechanism behind young drivers’ distracted driving behaviour based on SOR theory
27. Sampling in interview-based qualitative research: A theoretical and practical guide10.1080/14780887.2013.801543 ↗
28. What is an adequate sample size? Operationalising data saturation for theory-based interview studies10.1080/08870440903194015 ↗
29. Qualitative interviewing and grounded theory analysis10.4135/9781452218403.n25 ↗
30. Bibliometric Analysis of Stimulus-Organism-Response Theory: Past Developments, Current Applications, and Future Trends
31. Subjective and objective sleepiness in the active individual10.3109/00207459008994241 ↗
32. Subjective sleepiness, simulated driving performance and blink duration: Examining individual differences10.1111/j.1365-2869.2006.00504.x ↗
33. Sleepiness and performance of professional drivers in a truck simulator—Comparisons between day and night driving10.1046/j.1365-2869.1996.00013.x ↗
34. A Validation of Subsidiary Reaction Time Against Detection of Roadside Obstacles during Prolonged Driving10.1080/00140137808931698 ↗
35. Blaiech, H., Neji, M., Wali, A., and Alimi, A.M. (2013, January 4–6). Emotion recognition by analysis of EEG signals. Proceedings of the 13th International Conference on Hybrid Intelligent Systems (HIS 2013), Gammarth, Tunisia.10.1109/HIS.2013.6920451 ↗
36. Sommer, D., and Golz, M. (September, January 31). Evaluation of PERCLOS based current fatigue monitoring technologies. Proceedings of the 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, Buenos Aires, Argentina.10.1109/IEMBS.2010.5625960 ↗
37. Soares, S., Monteiro, T., Lobo, A., Couto, A., Cunha, L., and Ferreira, S. (2020). Analyzing driver drowsiness: From causes to effects. Sustainability, 12.10.3390/su12051971 ↗
38. Drowsiness, fatigue and poor sleep’s causes and detection: A comprehensive study10.1109/ACCESS.2019.2951028 ↗
39. Driving simulator experiments to study drowsiness: A systematic review10.1080/15389588.2019.1706088 ↗
40. Lal, S. (2004, January 14–16). Behavioural road safety management. Proceedings of the Road Safety Research, Policing and Education Conference, Perth, WA, Australia.
42. Electroencephalogram and electrocardiograph assessment of mental fatigue in a driving simulator10.1016/j.aap.2011.11.019 ↗
43. Magaña, V.C., Scherz, W.D., Seepold, R., Madrid, N.M., Pañeda, X.G., and Garcia, R. (2020). The effects of the driver’s mental state and passenger compartment conditions on driving performance and driving stress. Sensors, 20.10.3390/s20185274 ↗
44. Assessment of physical work demands of long-distance industrial gas delivery truck drivers10.1016/j.apergo.2020.103224 ↗
45. Driver fatigue in taxi, ride-hailing, and ridesharing services: A systematic review10.1080/01441647.2023.2278446 ↗
46. Krysiński, D. (2015, January 28–30). Between Postmodern Sustainable Transport Policy and Modern Habits of People: A Private Car in Biographical Experiences of Polish Drivers. Proceedings of the European Transport Conference 2015Association for European Transport (AET), Frankfurt, Germany.
47. Driver sleepiness on YouTube: A content analysis10.1016/j.aap.2015.11.025 ↗
48. Nass, C., Jonsson, I.-M., Harris, H., Reaves, B., Endo, J., Brave, S., and Takayama, L. (2005, January 2–7). Improving automotive safety by pairing driver emotion and car voice emotion. Proceedings of the CHI’05 Extended Abstracts on Human Factors in Computing Systems, Portland, OR, USA.10.1145/1056808.1057070 ↗
49. Multimodal user interaction with in-car equipment in real conditions based on touch and speech modes in the Persian language10.1007/s11042-022-13784-1 ↗
50. Factors affecting drivers’ off-road glance behavior while interacting with in-vehicle voice interfaces10.1016/j.aap.2022.106883 ↗
51. The impact of in-vehicle voice interaction system on driving safety10.1088/1742-6596/1802/4/042083 ↗
52. Measuring sociality in driving interaction10.1109/TITS.2024.3383867 ↗
53. Huang, S., Zhao, X., Wei, D., Song, X., and Sun, Y. (2024, January 11–16). Chatbot and Fatigued Driver: Exploring the Use of LLM-Based Voice Assistants for Driving Fatigue. Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.10.1145/3613905.3651031 ↗
54. Driver fatigue: Electroencephalography and psychological assessment10.1017/S0048577201393095 ↗
55. Lee, J., Hirano, T., Hano, T., and Itoh, M. (2019, January 6–9). Conversation during partially automated driving: How attention arousal is effective on maintaining situation awareness. Proceedings of the 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), Bari, Italy.10.1109/SMC.2019.8914632 ↗
56. Karatas, N., Yoshikawa, S., and Okada, M. (2016, January 4–7). Namida: Sociable driving agents with multiparty conversation. Proceedings of the Fourth International Conference on Human Agent Interaction, Singapore.10.1145/2974804.2974811 ↗
57. Being watched over by a conversation robot may enhance safety in simulated driving10.1016/j.jsr.2019.09.010 ↗
58. Exploring the effectiveness of a digital voice assistant to maintain driver alertness in partially automated vehicles10.1080/15389588.2021.1904138 ↗
59. Driven to discussion: Engaging drivers in conversation with a digital assistant as a countermeasure to passive task-related fatigue10.1049/iet-its.2017.0201 ↗
60. The Intersection of Voice Assistants and Autonomous Vehicles: A Scoping Review10.1177/10711813241275908 ↗
61. Liu, S. (2015). An Experimental Study of Driver Fatigue: Subjective Driver Fatigue Score, Driving Performance, and Driver Fatigue Countermeasures. [Ph.D. Thesis, McMaster University].
62. Blinks and saccades as indicators of fatigue in sleepiness warnings: Looking tired?10.1080/00140130701817062 ↗
63. The short-term effect of verbally assessing drivers’ state on vigilance indices during monotonous daytime driving10.1016/j.trf.2011.01.005 ↗
64. A critical review of the psychophysiology of driver fatigue10.1016/S0301-0511(00)00085-5 ↗
65. Active and passive fatigue in simulated driving: Discriminating styles of workload regulation and their safety impacts10.1037/a0034386 ↗