Interface Design for Responsible Remote Driving: A Study on Technological Mediation
Source abstract
Abstract
Remote driving, i.e., the capacity of controlling road vehicles at a distance, is an innovative transportation technology often associated with potential ethical benefits, especially when deployed to tackle urban traffic issues. However, prospected benefits could only be reaped if remote driving can be executed in a safe and responsible way. This paper builds on notions elaborated in the philosophical literature on technological mediation to offer a systematic examination of the extent to which current and emerging Human–Machine Interfaces contribute to hindering or supporting the exercise of responsibility behind the remote wheel. More specifically, the analysis discusses how video, audio, and haptic interfaces co-shape the remote driving experience and, at the same time, the operators’ capacity to drive responsibly. The multidisciplinary approach explored in this research offers a novel methodological framework to structure future empirical inquiries while identifying finely tuned multi-sensory HMIs and dedicated training as critical presuppositions to the remote drivers’ exercise of responsibility.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Human-Automation Interaction and Safety · Autonomous Vehicle Technology and Safety · Transportation and Mobility Innovations
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Design, Politecnico di Milano, Via Giuseppe Candiani 72, 20158 Milan, Italy
Department of Mechanical Engineering, Politecnico di Milano, Via Giuseppe La Masa 1, 20156 Milan, Italy
Funding
Centro Nazionale per la Mobilità Sostenibile-CNMS · European Union NextGenerationEU
References (64)
Show source-provided references
1. A Survey on Remote Operation of Road Vehicles10.1109/ACCESS.2022.3229168 ↗
2. Zhao, L., Nybacka, M., Aramrattana, M., Rothhämel, M., Habibovic, A., Drugge, L., and Jiang, F. (2024). Remote Driving of Road Vehicles: A Survey of Driving Feedback, Latency, Support Control, and Real Applications. IEEE Trans. Intell. Veh., 1–22.10.1109/TIV.2024.3362597 ↗
3. Baraniuk, C. (2025, February 24). The Forklift Truck Drivers Who Never Leave Their Desks. Available online: https://www.bbc.com/news/business-54431056.
4. Vehicle Teleoperation Interfaces10.1023/A:1011295826834 ↗
5. UGV History 101: A Brief History of Unmanned Ground Vehicle (UGV) Development Efforts
6. Rogowitz, B.E., and Pappas, T.N. (1999, January 23–29). Virtual reality mapping system for chernobyl accident site assessment. Proceedings of the Human Vision and Electronic Imaging IV, San Jose, CA, USA.
7. Tener, F., and Lanir, J. (May, January 29). Driving from a Distance: Challenges and Guidelines for Autonomous Vehicle Teleoperation Interfaces. Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA.10.1145/3491102.3501827 ↗
8. Kallioniemi, P., Burova, A., Mäkelä, J., Keskinen, T., Ronkainen, K., Mäkelä, V., Hakulinen, J., and Turunen, M. (2021). Multimodal Warnings in Remote Operation: The Case Study on Remote Driving. Multimodal Technol. Interact., 5.10.3390/mti5080044 ↗
9. UNECE (2025, February 24). Informal Paper on Remote Driving. Informal Document No.1., Available online: https://unece.org/sites/default/files/2021-09/ECE-TRANS-WP1-2021-Informal%20document-1e_2.pdf.
10. Kang, L., Zhao, W., Qi, B., and Banerjee, S. (2018, January 12–13). Augmenting Self-Driving with Remote Control. Proceedings of the 19th International Workshop on Mobile Computing Systems & Applications, Tempe, AZ, USA.10.1145/3177102.3177104 ↗
11. Kettwich, C., Schrank, A., Avsar, H., and Oehl, M. (2022). A Helping Human Hand: Relevant Scenarios for the Remote Operation of Highly Automated Vehicles in Public Transport. Appl. Sci., 12.10.3390/app12094350 ↗
12. SAE—Society of Automotive Engineers (2021). Taxonomy and Definitions for Terms Related to Driving Automation Systems for on-Road Motor Vehicles, SAE. Available online: https://www.sae.org/standards/content/j3016_202104/.
13. Endsley, M.R., and Jones, D.G. (2012). Designing for Situation Awareness: An Approach to User-Centered Design, CRC Press. [2nd ed.].
14. Gnatzig, S., Chucholowski, F.E., Tang, T., Lienkamp, M., and Chucholowski, F. (July, January 29). A System Design for Teleoperated Road Vehicles. Proceedings of the International Conference on Informatics in Control, Automation and Robotics, Reykjavík, Iceland. Available online: https://www.researchgate.net/publication/256946185.
15. Kettwich, C., Schrank, A., and Oehl, M. (2021). Teleoperation of Highly Automated Vehicles in Public Transport: User-Centered Design of a Human-Machine Interface for Remote-Operation and Its Expert Usability Evaluation. Multimodal Technol. Interact., 5.10.3390/mti5050026 ↗
16. Updating our understanding of situation awareness in relation to remote operators of autonomous vehicles10.1186/s41235-021-00271-8 ↗
17. Fossa, F. (2023). Ethics of Driving Automation: Artificial Agency and Human Values, Springer.10.1007/978-3-031-22982-4 ↗
18. Integrating Autonomous Electric Vehicles into Existing Urban Transportation Systems: Challenges and Opportunities
19. European Enviromental Agency (2023). Trends and Projections in Europe 2023, EEA Report.
20. Trends in passenger transport optimisation10.1111/itor.13300 ↗
21. The spatial reconfiguration of parking demand due to car sharing diffusion: A simulated scenario for the cities of Milan and Turin (Italy)10.1016/j.jtrangeo.2021.103276 ↗
22. Shared autonomous vehicle services: A comprehensive review10.1016/j.trc.2019.12.008 ↗
23. Moreno, C. (2015). The 15-Minute City: A Solution to Saving Our Time & Our Planet, Wiley.
24. Bates, J., and Leibling, D. (2012). Spaced Out. Perspectives on Parking Policy, Royal Automobile Club Foundation for Motoring.
25. UNECE (2020). Human Factors Challenges of Remote Support and Control: A Position Paper from HF-IRADS 1, UNECE. Available online: https://unece.org/fileadmin/DAM/trans/doc/2020/wp29grva/GRVA-07-65e.pdf.
26. Björnberg, K.E., Hansson, S.O., Belin, M.-Å., and Tingvall, C. (2022). The Vision Zero Handbook. Theory, Technology and Management for a Zero Casualty Policy, Springer.
27. Marshall, W. (2024). Killed by a Traffic Engineer: Shattering the Delusion That Science Underlies Our Transportation System, Island Press.
28. Edvardsson Björnberg, K., Belin, M.Å., Hansson, S.O., and Tingvall, C. (2022). Responsibility in Road Traffic. The Vision Zero Handbook, Springer.10.1007/978-3-030-76505-7 ↗
29. Ihde, D. (1979). Technics and Praxis: A Philosophy of Technology, Springer.10.1007/978-94-009-9900-8 ↗
30. Ihde, D. (1990). Technology and the Lifeworld: From Garden to Earth, Indiana University Press.
31. Verbeek, P.-P. (2005). What Things Do: Philosophical Reflections on Technology, Agency, and Design, Penn State University Press.10.1515/9780271033228 ↗
32. Verbeek, P.-P. (2011). Moralizing Technology: Understanding and Designing the Morality of Things, The University of Chicago Press.10.7208/chicago/9780226852904.001.0001 ↗
33. Rosenberger, R., and Verbeek, P.-P. (2015). Postphenomenological Investigations: Essays on Human–Technology Relations, Lexington Books.
34. Jensen, M.M., and Aagaard, J. (2018, January 4–7). A Postphenomenological Method for HCI Research. Proceedings of the 30th Australian Conference on Computer-Human Interaction (OzCHI ’18), New York, NY, USA.10.1145/3292147.3292170 ↗
35. Interface design in services: A postphenomenological approach10.1162/DESI_a_00192 ↗
36. Unit, vibration, tone: A post-phenomenological method for researching digital interfaces10.1177/1474474017726556 ↗
37. Situation awareness misconceptions and misunderstandings10.1177/1555343415572631 ↗
38. Graf, G., and Hussmann, H. (2020, January 21–22). User Requirements for Remote Teleoperation-Based Interfaces. Proceedings of the 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Virtual Event.10.1145/3409251.3411730 ↗
39. Majstorovic, D., Hoffmann, S., Pfab, F., Schimpe, A., Wolf, M.-M., and Diermeyer, F. (2022, January 9–12). Survey on Teleoperation Concepts for Automated Vehicles. Proceedings of the 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Prague, Czech Republic.10.1109/SMC53654.2022.9945267 ↗
40. (2018). Uniform Provisions Concerning the Approval of Motor Vehicles with Regard to the Forward Field of Vision of the Motor Vehicle Driver [2018/116]. Off. J. Eur. Union I.20/16, 1–18. Available online: https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:42018X0116&qid=1691068600238.
41. Human performance issues and user interface design for teleoperated robots10.1109/TSMCC.2007.905819 ↗
42. Occupants’ Motion Comfort and Driver’s Feel: An Explorative Study About Their Relation in Remote Driving10.1109/TITS.2024.3378778 ↗
43. Driving Experience and Behavior Change in Remote Driving—An Explorative Experimental Study10.1109/TIV.2023.3344890 ↗
44. Terrien, G., Fong, T., Thorpe, C., and Baur, C. (2000). Remote Driving with a Multisensor User Interface, SAE. SAE Technical Paper.10.4271/2000-01-2358 ↗
45. Augmented visualization with depth perception cues to improve the surgeon’s performance in minimally invasive surgery10.1007/s11517-018-1929-6 ↗
46. Hosseini, A., and Lienkamp, M. (2016, January 19–22). Enhancing Telepresence During the Teleoperation of Road Vehicles Using HMD-Based Mixed Reality. Proceedings of the 2016 IEEE Intelligent Vehicles Symposium (IV), Gothenburg, Sweden.10.1109/IVS.2016.7535568 ↗
47. Sasai, S., Kitahara, I., Kameda, Y., Ohta, Y., Kanbara, M., Morales, Y., Ukita, N., Hagita, N., Ikeda, T., and Shinozawa, K. (October, January 29). MR Visualization of Wheel Trajectories of Driving Vehicle by Seeing-Through Dashboard. Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality Workshops, Fukuoka, Japan.10.1109/ISMARW.2015.17 ↗
48. Bout, M., Brenden, A.P., Klingegård, M., Habibovic, A., and Böckle, M.-P. (2017, January 24–27). A Head-Mounted Display to Support Teleoperations of Shared Automated Vehicles. Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct, Oldenburg, Germany.10.1145/3131726.3131758 ↗
49. Georg, J.-M., Feiler, J., Diermeyer, F., and Lienkamp, M. (2018, January 4–7). Teleoperated Driving, a Key Technology for Automated Driving? Comparison of Actual Test Drives with a Head Mounted Display and Conventional Monitors. Proceedings of the 2018 21st International Conference on Intelligent Transportation Systems (ITSC), Maui, HI, USA.10.1109/ITSC.2018.8569408 ↗
50. (2006). Directive 2006/126/Ec of the European Parliament and of the Council of 20 December 2006 on Driving Licences (Recast). Off. J. Eur. Union I.403/18, 1–43. Available online: https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32006L0126&from=EN.
51. Bengler, K., Rettenmaier, M., Fritz, N., and Feierle, A. (2020). From HMI to HMIs: Towards an HMI Framework for Automated Driving. Information, 11.10.3390/info11020061 ↗
52. External HMI for self-driving vehicles: Which information shall be displayed?10.1016/j.trf.2019.12.009 ↗
53. Orienting spatial attention to sounds enhances visual processing10.1016/j.copsyc.2019.03.010 ↗
54. The Use of Haptic and Tactile Information in the Car to Improve Driving Safety: A Review of Current Technologies10.3389/fict.2018.00005 ↗
55. Breitschaft, S.J., Clarke, S., and Carbon, C.-C. (2019). A Theoretical Framework of Haptic Processing in Automotive User Interfaces and Its Implications on Design and Engineering. Front. Psychol., 10.10.3389/fpsyg.2019.01470 ↗
56. Park, K., Youn, E., Kim, S., Kim, Y., and Lee, G. (2021, January 12–15). Design of acceleration feedback of UGV using a Stewart platform. Proceedings of the 2021 21st International Conference on Control, Automation and Systems (ICCAS), Jeju, Republic of Korea.10.23919/ICCAS52745.2021.9648847 ↗
57. Luz, R., Corujeira, J., Silva, J.L., and Ventura, R. (2018, January 27–31). Traction Awareness Through Haptic Feedback for the Teleoperation of UGVs. Proceedings of the 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Nanjing, China.10.1109/ROMAN.2018.8525740 ↗
58. Corujeira, J., Silva, J.L., and Ventura, R. (2018, January 27–31). Attitude Perception of an Unmanned Ground Vehicle Using an Attitude Haptic Feedback Device. Proceedings of the 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Nanjing, China.10.1109/ROMAN.2018.8525693 ↗
59. Fong, T., Conti, F., Grange, S., and Baur, C. (2001, January 5–8). Novel Interfaces for Remote Driving: Gesture, Haptic and PDA. Proceedings of the Mobile Robots XV and Telemanipulator and Telepresence Technologies VII, Boston, MA, USA.
60. Corrall, M. (2020). Design Guide for Gesture Control in Automotive HMI, Ultraleap. Available online: https://www.ultraleap.com/company/news/blog/gesture-control-automotive-hmi/.
61. Morrell, J., and Wasilewski, K. (2010, January 25–26). Design and Evaluation of a Vibrotactile Seat to Improve Spatial Awareness While Driving. Proceedings of the 2010 IEEE Haptics Symposium, Waltham, MA, USA.10.1109/HAPTIC.2010.5444642 ↗
62. Budiu, R. (2019). Tesla’s Touchscreen UI: A Case Study of Car-Dashboard User Interface, Nielsen Norman Group. Available online: https://www.nngroup.com/articles/tesla-big-touchscreen/.
63. Chen, J., Moemeni, A., and Caleb-Solly, P. (2023, January 13–16). Comparing a Graphical User Interface, Hand Gestures and Controller in Virtual Reality for Robot Teleoperation. Proceedings of the Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction, Stockholm, Sweden.10.1145/3568294.3580165 ↗
64. Calhoun, G.L., Fontejon, J.V., Draper, M.H., Ruff, H.A., and Guilfoos, B.J. (2004, January 1). Tactile versus Aural Redundant Alert Cues for UAV Control Applications. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, New Orleans, LA, USA. Issue 1.10.1037/e577062012-029 ↗