journal article·2025-10-22Open access

From Overtrust to Distrust: A Simulation Study on Driver Trust Calibration in Conditional Automated Driving

Heetae Hwang, Juhyeon Kim, Hojoon Kim, Heewon Min, Kyudong Park

Applied Sciences· Volume 15· Issue 21

Abstract

Conditional automated driving delegates routine control to automation while keeping drivers responsible for supervision and timely takeovers. In this context, safety and usability hinge on calibrated trust, a state between overtrust and distrust that aligns reliance with actual system capabilities. We investigated how calibrated trust relates to concurrent behavior during conditional automation in a driving-simulator study (n = 26). After a brief familiarization block, drivers completed four takeover request (TOR) exposures while performing a non-driving-related task (NDRT). Trust was assessed with a validated multi-item inventory. NDRT engagement was operationalized as successful Surrogate Reference Task (SuRT) clicks per second, and takeover behavior was indexed by TOR reaction time (TOR-RT) from TOR onset to the first valid control input. The results showed that higher trust was associated with greater ND RT throughput during automated driving, whereas TOR-RT did not change significantly across repeated exposures, consistent with familiarization. In this sample, we did not observe a systematic penalty in TOR-RT associated with higher trust; however, confidence-interval benchmarks indicate that modest delays cannot be ruled out. This suggests that, after brief onboarding, calibrated trust can coexist with timely safety-critical responses within the limits of our design. These findings tentatively support interface and training strategies that promote calibrated trust (e.g., predictable TOR policies, transparent capability boundaries, and short onboarding) to help drivers navigate between overtrust and distrust.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Autonomous Vehicle Technology and Safety · Human-Automation Interaction and Safety · Traffic control and management

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Industrial and Management Engineering, Pohang University of Science and Technology, Pohang 37673, Republic of Korea

Designovel Co., Ltd., Seoul 06180, Republic of Korea

Department of Artificial Intelligence Applications, Kwangwoon University, Seoul 01897, Republic of Korea

Funding

IIT · National Research Foundation of Kore · Kwangwoon University

References (44)

Show source-provided references
1. (2018). Taxonomy and Definitions for Terms Related to Driving Automation Systems for on-Road Motor Vehicles (Standard No. SAE J3016).
2. Hong, S., Maeng, J., Kim, H.J., and Yang, J.H. (2022, January 17–20). Development of warning methods for planned and unplanned takeover requests in a simulated automated driving vehicle. Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Seoul, Republic of Korea.10.1145/3543174.3545999 ↗
3. Humans and automation: Use, misuse, disuse, abuse10.1518/001872097778543886 ↗
4. Shifting gears: User interfaces in the age of autonomous driving10.1109/MPRV.2016.14 ↗
5. Trust, self-confidence, and operators’ adaptation to automation10.1006/ijhc.1994.1007 ↗
6. Trust between humans and machines, and the design of decision aids10.1016/S0020-7373(87)80013-5 ↗
7. Trust in automation: Integrating empirical evidence on factors that influence trust10.1177/0018720814547570 ↗
8. Trust in automation: Designing for appropriate reliance10.1518/hfes.46.1.50.30392 ↗
9. The more you know: Trust dynamics and calibration in highly automated driving and the effects of take-overs, system malfunction, and system transparency10.1177/0018720819853686 ↗
10. Calibration of trust in automated driving: A matter of initial level of trust and automated driving style?10.1177/00187208211052804 ↗
11. How the initial level of trust in automated driving impacts drivers’ behaviour and early trust construction10.1016/j.trf.2022.02.006 ↗
12. Effect of Takeover Request Time and Warning Modality on Trust in L3 Automated Driving10.1177/00187208241278433 ↗
13. Shared intention and shared awareness for conditional automated driving: An online, randomized video experiment10.1080/15389588.2024.2421215 ↗
14. Kohn, S.C., De Visser, E.J., Wiese, E., Lee, Y.C., and Shaw, T.H. (2021). Measurement of trust in automation: A narrative review and reference guide. Front. Psychol., 12.10.3389/fpsyg.2021.604977 ↗
15. Keep your scanners peeled: Gaze behavior as a measure of automation trust during highly automated driving10.1177/0018720815625744 ↗
16. Petersen, L., Robert, L., Yang, X.J., and Tilbury, D.M. (2019). Situational awareness, drivers trust in automated driving systems and secondary task performance. arXiv.10.2139/ssrn.3345543 ↗
17. Azevedo-Sa, H., Zhao, H., Esterwood, C., Yang, X.J., Tilbury, D.M., and Robert, L.P. (2021). How internal and external risks affect the relationships between trust and driver behavior in automated driving systems. Transp. Res. Part C Emerg. Technol., 123.10.1016/j.trc.2021.102973 ↗
18. Introduction matters: Manipulating trust in automation and reliance in automated driving10.1016/j.apergo.2017.07.006 ↗
19. Helldin, T., Falkman, G., Riveiro, M., and Davidsson, S. (2013, January 27–30). Presenting system uncertainty in automotive UIs for supporting trust calibration in autonomous driving. Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Eindhoven, The Netherlands.10.1145/2516540.2516554 ↗
20. Fully automated driving: Impact of trust and practice on manual control recovery10.1177/0018720815612319 ↗
21. Toreini, E., Aitken, M., Coopamootoo, K., Elliott, K., Zelaya, C.G., and Van Moorsel, A. (2020, January 27–30). The relationship between trust in AI and trustworthy machine learning technologies. Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, Barcelona, Spain.10.1145/3351095.3372834 ↗
22. How in the world did we ever get into that mode? Mode error and awareness in supervisory control10.1518/001872095779049516 ↗
23. Sheridan, T.B. (2002). Humans and Automation: System Design and Research Issues, John Wiley Sons.
24. The role of trust in automation reliance10.1016/S1071-5819(03)00038-7 ↗
25. A meta-analysis of factors affecting trust in human-robot interaction10.1177/0018720811417254 ↗
26. Not all trust is created equal: Dispositional and history-based trust in human-automation interactions10.1518/001872008X288574 ↗
27. Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation10.1080/00140139608964474 ↗
28. Towards a theory of longitudinal trust calibration in human–robot teams10.1007/s12369-019-00596-x ↗
29. Forster, Y., Kraus, J., Feinauer, S., and Baumann, M. (2019, January 21–25). Calibration of trust expectancies in conditionally automated driving by brand, reliability information and introductory videos: An online study. Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Utrecht, The Netherlands.
30. Automation transparency: Implications of uncertainty communication for human-automation interaction and interfaces10.1080/00140139.2018.1547842 ↗
31. Foundations for an empirically determined scale of trust in automated systems10.1207/S15327566IJCE0401_04 ↗
32. Ullman, D., and Malle, B.F. (2019, January 11–14). Measuring gains and losses in human-robot trust: Evidence for differentiable components of trust. Proceedings of the 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Daegu, Republic of Korea.10.1109/HRI.2019.8673154 ↗
33. Initial validation of the trust of automated systems test (TOAST)10.1080/00224545.2020.1749020 ↗
34. Development and validation of the system trustworthiness scale10.1177/00187208231189000 ↗
35. Hungund, A.P., and Pradhan, A.K. (2023). Impact of non-driving related tasks while operating automated driving systems (ADS): A systematic review. Accid. Anal. Prev., 188.10.1016/j.aap.2023.107076 ↗
36. Effects of unreliable automation, non-driving related task, and takeover time budget on drivers’ takeover performance and workload10.1080/00140139.2022.2069868 ↗
37. Yun, H., Lee, J.W., Yang, H.D., and Yang, J.H. (2018, January 15–20). Experimental Design for Multi-modal Take-over Request for automated driving. Proceedings of the International Conference on Human-Computer Interaction, Las Vegas, NV, USA.10.1007/978-3-319-92285-0_57 ↗
38. A comparison of the two one-sided tests procedure and the power approach for assessing the equivalence of average bioavailability10.1007/BF01068419 ↗
39. Determinants of take-over time from automated driving: A meta-analysis of 129 studies10.1016/j.trf.2019.04.020 ↗
40. Modeling take-over performance in level 3 conditionally automated vehicles10.1016/j.aap.2017.11.009 ↗
41. Complacency and bias in human use of automation: An attentional integration10.1177/0018720810376055 ↗
42. Parasuraman, R., Bahri, T., Deaton, J.E., Morrison, J.G., and Barnes, M. (1992). Theory and Design of Adaptive Automation in Aviation Systems, Naval Air Warfare Center Aircraft Division. No. NAWCADWAR-92033-60.
43. An investigation of drivers’ dynamic situational trust in conditionally automated driving10.1109/THMS.2021.3131676 ↗
44. Lu, Y., and Sarter, N. (2020, January 5–9). Modeling and inferring human trust in automation based on real-time eye tracking data. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Chicago, IL, USA.10.1177/1071181320641078 ↗