Visualizing Driving Maneuvers Through Peripheral Displays: A Comparative Study of iHMI Design in Autonomous Vehicles
Source abstract
Abstract
Autonomous driving is anticipated to increase safety, efficiency, and accessibility of passenger transportation. Passengers are given freedom in the use of travel time through the potential to conduct non-driving related tasks (NDRTs). However, factors such as trust and motion sickness pose challenges to the widespread adoption of this technology. Human–machine interfaces (HMIs) have shown potential in mitigating motion sickness and fostering trust calibration in autonomous vehicles (AVs), e.g., by visualizing upcoming or current maneuvers of the vehicle. The majority of research on such HMIs relies on the passengers’ attention, preventing uninterrupted NDRT execution and thus impeding the automation’s usefulness. In this paper, we present a visual HMI, providing AV passengers with information about current driving maneuvers through their peripheral fields of view. This method of information transmission is compared to conventional in-vehicle displays and LED strips regarding perceptibility and distraction. In a controlled laboratory setting, N = 34 participants experienced each HMI condition, indicating their perception of the maneuver visualizations using joystick input while either focusing on a fixation cross to measure perceptibility or solving math tasks to measure distraction. The peripheral HMIs caused better maneuver perception (ηp2=0.12) and lower distraction (ηg2=0.16) from a visual NDRT than the conventional displays. These results yield implications for the design of HMIs for motion sickness mitigation and trust calibration in AVs.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Human-Automation Interaction and Safety · Virtual Reality Applications and Impacts · Spatial Neglect and Hemispheric Dysfunction
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Research Institute for Automotive Lighting and Mechatronics (L-LAB), Rixbecker Str. 75, 59557 Lippstadt, Germany
Faculty 2, Technische Universität Braunschweig, Gausstr. 23, 38106 Braunschweig, Germany
Immersive Reality Lab, Hochschule Hamm-Lippstadt, Dr.-Arnold-Hueck-Straße 3, 59557 Lippstadt, Germany
HELLA GmbH & Co. KGaA, Rixbecker Straße 75, 59557 Lippstadt, Germany
Funding
German Federal Ministry for Economic Affairs and Energy · HELLA GmbH & Co. KGaA · Technical University of Braunschweig
References (55)
Show source-provided references
1. Benleulmi, A.Z., and Blecker, T. (2017, January 12–13). Investigating the Factors Influencing the Acceptance of Fully Autonomous Cars. Proceedings of the Hamburg International Conference of Logistics (HICL), Hamburg, Germany. 23.
2. Self-Driving Carsickness10.1016/j.apergo.2015.09.009 ↗
3. A Multi-Level Model on Automated Vehicle Acceptance (MAVA): A Review-Based Study10.1080/1463922X.2019.1621406 ↗
4. Interrelationships among Predictors of Automated Vehicle Acceptance: A Structural Equation Modelling Approach10.1080/1463922X.2020.1814446 ↗
5. A Structural Equation Modeling Approach for the Acceptance of Driverless Automated Shuttles Based on Constructs from the Unified Theory of Acceptance and Use of Technology and the Diffusion of Innovation Theory10.1016/j.trf.2021.01.001 ↗
6. Osswald, S., Wurhofer, D., Trösterer, S., Beck, E., and Tscheligi, M. (2012, January 17–19). Predicting Information Technology Usage in the Car: Towards a Car Technology Acceptance Model. Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Portsmouth, NH, USA.10.1145/2390256.2390264 ↗
7. On the Attitudes Toward Automation in Determining the Intention to Use Automated Buses in Scotland10.1177/03611981231159116 ↗
8. Consumer Acceptance and Use of Information Technology: Extending the Unified Theory of Acceptance and Use of Technology10.2307/41410412 ↗
9. What Drives People to Accept Automated Vehicles? Findings from a Field Experiment10.1016/j.trc.2018.07.024 ↗
10. The Roles of Initial Trust and Perceived Risk in Public’s Acceptance of Automated Vehicles10.1016/j.trc.2018.11.018 ↗
11. What Drives People to Use Automated Vehicles? A Meta-Analytic Review10.1016/j.aap.2021.106270 ↗
12. Public Perception of Autonomous Vehicle Capability Determines Judgment of Blame and Trust in Road Traffic Accidents10.1016/j.tra.2023.103887 ↗
13. Modeling Public Acceptance of Private Autonomous Vehicles: Value of Time and Motion Sickness Viewpoints10.1016/j.trc.2021.103548 ↗
14. Jorlöv, S., Bohman, K., and Larsson, A. (2017, January 13–15). Seating Positions and Activities in Highly Automated Cars—A Qualitative Study of Future Automated Driving Scenarios. Proceedings of the IRCOBI Conference Proceedings, Antwerp, Belgium.
15. Setting the Stage for Autonomous Cars: A Pilot Study of Future Autonomous Driving Experiences10.1049/iet-its.2014.0168 ↗
16. Shaping Driver-Vehicle Interaction in Autonomous Vehicles: How the New in-Vehicle Systems Match the Human Needs10.1016/j.apergo.2020.103238 ↗
17. Motion Sickness in Automated Vehicles with Forward and Rearward Facing Seating Orientations10.1016/j.apergo.2019.02.001 ↗
18. Metzulat, M., Metz, B., Edelmann, A., Neukum, A., and Kunde, W. (2025). Sick of Being Driven?—Prevalence and Modulating Factors of Carsickness in the European Population in Context of Automated Driving. arXiv.10.1016/j.apergo.2025.104590 ↗
19. Motion Sickness Adaptation: A Neural Mismatch Model10.1177/014107687807101109 ↗
20. Influence of Seating Orientation on Motion Sickness in Autonomous Vehicles10.1016/j.apergo.2025.104643 ↗
21. Sharples, S., and Shorrock, S. (2014). Will Autonomous Vehicles Make Us Sick?. Contemporary Ergonomics and Human Factors 2014, Taylor & Francis.
22. Visual Field Effects on Motion Sickness in Cars
23. Rottmann, L., Waldmann, A., Johannsen, A., and Vollrath, M. (Preprint, 2025). Rearward Seating Orientation Decreases Trust and Increases Motion Sickness in Autonomous Vehicles, Preprint, preprint.10.20944/preprints202510.1199.v1 ↗
24. Using a Situational Awareness Display to Improve Rider Trust and Comfort with an AV Taxi10.1177/1071181319631428 ↗
25. Hanau, E., and Popescu, V. (2017, January 24–27). MotionReader: Visual Acceleration Cues for Alleviating Passenger E-Reader Motion Sickness. Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct, Oldenburg, Germany.10.1145/3131726.3131741 ↗
26. Looking Forward: In-vehicle Auxiliary Display Positioning Affects Carsickness10.1016/j.apergo.2017.11.002 ↗
27. The Influence of System Transparency on Trust: Evaluating Interfaces in a Highly Automated Vehicle10.1016/j.trf.2020.06.001 ↗
28. Investigating the Importance of Trust on Adopting an Autonomous Vehicle10.1080/10447318.2015.1070549 ↗
29. Stanton, N.A. (2018). Information Expectations in Highly and Fully Automated Vehicles. Advances in Human Aspects of Transportation, Proceedings of the AHFE 2017, Los Angeles, CA, USA, 17–21 July 2017, Springer.10.1007/978-3-319-60441-1 ↗
30. Trust in Automation: Integrating Empirical Evidence on Factors That Influence Trust10.1177/0018720814547570 ↗
31. Great Expectations: On the Design of Predictive Motion Cues to Alleviate Carsickness10.1007/978-3-030-78358-7_16 ↗
32. Effects of Dynamic Visual Stimuli on the Development of Carsickness in Real Driving10.1109/TITS.2021.3128834 ↗
33. Hainich, R., Drewitz, U., Ihme, K., Lauermann, J., Niedling, M., and Oehl, M. (2021). Evaluation of a Human–Machine Interface for Motion Sickness Mitigation Utilizing Anticipatory Ambient Light Cues in a Realistic Automated Driving Setting. Information, 12.10.3390/info12040176 ↗
34. Efficacy of Augmented Visual Environments for Reducing Sickness in Autonomous Vehicles10.1016/j.apergo.2020.103282 ↗
35. Multiple Resources and Performance Prediction10.1080/14639220210123806 ↗
36. DARMA: Software for Dual Axis Rating and Media Annotation10.3758/s13428-017-0915-5 ↗
37. Hart, S.G. (1986). NASA Task Load Index (TLX): Computerized Version—Volume 1.0, NASA.
38. A Meta-Analysis of Simulator Sickness as a Function of Simulator Fidelity10.1007/s00221-022-06485-6 ↗
39. Too Sick to Take over?—Impact of Car Sickness on Cognitive Performance Related to Driving in the Context of Automated Driving10.1016/j.trf.2024.12.027 ↗
40. Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness10.1207/s15327108ijap0303_3 ↗
41. Predicting Individual Differences in Motion Sickness Susceptibility by Questionnaire10.1016/j.paid.2006.01.012 ↗
42. A Personal Resource for Technology Interaction: Development and Validation of the Affinity for Technology Interaction (ATI) Scale10.1080/10447318.2018.1456150 ↗
43. Rottmann, L., Stang, A., Johannsen, A., and Niedling, M. (2025, January 22–24). Designing a Light-Based Extension of the Vehicle Environment for Motion Sickness Mitigation. Proceedings of the 16th International Symposium on Automotive Lighting 2025, Darmstadt, Germany.
44. Künzer, L. (2016). “Alarmstufe Rot!” oder “Alles im grünen Bereich!” Farben im Kontext von Gefahr und Sicherheit. [Ph.D. Thesis, Universität Regensburg].
45. Wobbrock, J.O., Findlater, L., Gergle, D., and Higgins, J.J. (2011, January 7–12). The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, New York, NY, USA. CHI ’11.10.1145/1978942.1978963 ↗
46. Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences, Routledge. [2nd ed.].
47. Detection and Discrimination of the Direction of Motion in Central and Peripheral Vision of Normal and Amblyopic Observers10.1016/0042-6989(84)90150-0 ↗
48. Using Optic Flow in the Far Peripheral Field10.1167/17.8.3 ↗
49. Influence of Central and Peripheral Visual Field on the Postural Control When Viewing an Optic Flow Stimulus10.1167/8.6.858 ↗
50. An Ecological Theory of Motion Sickness and Postural Instability10.1207/s15326969eco0303_2 ↗
51. Leukel, C., Lundbye-Jensen, J., Christensen, M.S., Gollhofer, A., Nielsen, J.B., and Taube, W. (2012). Subconscious Visual Cues during Movement Execution Allow Correct Online Choice Reactions. PLoS ONE, 7.10.1371/journal.pone.0044496 ↗
52. Peripheral Vision in Real-World Tasks: A Systematic Review10.3758/s13423-022-02117-w ↗
53. Liang, Z., Wang, Y., Qian, C., Wang, Y., Zhao, C., Du, H., Deng, J., Li, X., and He, Y. (2024). A Driving Simulator Study to Examine the Impact of Visual Distraction Duration from In-Vehicle Displays: Driving Performance, Detection Response, and Mental Workload. Electronics, 13.10.3390/electronics13142718 ↗
54. An On-Road Study in Mitigating Motion Sickness When Reading in Automated Driving
55. Intra-Visual Conflict in Visually Induced Motion Sickness10.1016/j.displa.2011.05.009 ↗