Enhancing User Engagement in Shared Autonomous Vehicles: An Innovative Gesture-Based Windshield Interaction System
Source abstract
Abstract
With the rapid advancement of autonomous vehicles, a transformative transportation paradigm is emerging in the automotive industry, necessitating a re-evaluation of how users engage with and utilize these evolving settings. This research paper introduces an innovative interaction system tailored for shared autonomous vehicles, focusing on its development and comprehensive evaluation. The proposed system uses the car’s windshield as an interactive display surface, enabling infotainment and real-time information about the surrounding environment. The integration of two gesture-based interfaces forms a central component of the system. Through a study involving twenty subjects, we analyzed and compared the user experience facilitated by these interfaces. The study outcomes demonstrated that the subjects exhibited similar behaviors and responses across both interfaces, thus validating the potential of these interaction systems for future autonomous vehicles. These findings collectively emphasize the transformative nature of the proposed system and its ability to enhance user engagement and interaction within the context of autonomous transportation.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Human-Automation Interaction and Safety · Virtual Reality Applications and Impacts · Transportation and Mobility Innovations
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Mechanical Engineering, Politecnico di Milano, Via La Masa 1, 20156 Milano, Italy
Department of Design, Politecnico di Milano, Via Durando 10, 20158 Milano, Italy
Funding
Regione Lombardia POR FESR 2014–2020
References (24)
Show source-provided references
1. Airline Head-Up Display Systems: Human Factors Considerations10.4172/2162-6359.1000248 ↗
2. Tonnis, M., Lange, C., and Klinker, G. (2007, January 13–16). Visual Longitudinal and Lateral Driving Assistance in the Head-Up Display of Cars. Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan.10.1109/ISMAR.2007.4538831 ↗
3. Halin, A., Verly, J.G., and Van Droogenbroeck, M. (2021). Survey and Synthesis of State of the Art in Driver Monitoring. Sensors, 21.10.3390/s21165558 ↗
4. Analyzing Drivers’ Attitude towards HUD System Using a Stated Preference Survey10.1155/2014/380647 ↗
5. (2023, July 14). Panasonic Drives You. Available online: https://na.panasonic.com/us/news/panasonic-automotive-brings-expansive-artificial-intelligence-enhanced-situational-awareness-driver.
6. Stecher, M., Michel, B., and Zimmermann, A. (2018). Advances in Human Aspects of Transportation. AHFE 2017. Advances in Intelligent Systems and Computing, Springer.
7. (2023, May 23). Survey on 3D Hand Gesture Recognition|IEEE Journals & Magazine|IEEE Xplore. Available online: https://ieeexplore.ieee.org/document/7208833.
8. Häuslschmid, R., Osterwald, S., Lang, M., and Butz, A. (April, January 29). Augmenting the Driver’s View with Peripheral Information on a Windshield Display. Proceedings of the 20th International Conference on Intelligent User Interfaces, Atlanta, GA, USA.
9. Ohn-Bar, E., Tran, C., and Trivedi, M. (2012, January 17–19). Hand Gesture-Based Visual User Interface for Infotainment. Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Portsmouth, UK.10.1145/2390256.2390274 ↗
10. May, K., Gable, T., and Walker, B. (2014, January 17–19). A Multimodal Air Gesture Interface for In Vehicle Menu Navigation. Proceedings of the Adjunct Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Seattle, WA, USA.10.1145/2667239.2667280 ↗
11. Pervasive Adaptation in Car Crowds
12. Brand, D., Büchele, K., and Meschtscherjakov, A. (2016, January 24–26). Pointing at the HUD: Gesture Interaction Using a Leap Motion. Proceedings of the Adjunct Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Ann Arbor, MI, USA.10.1145/3004323.3004343 ↗
13. Lindgren, T. (2022, January 4–7). Experiencing Electric Vehicles: The Car as a Digital Platform. Proceedings of the 55th Hawaii International Conference on System Sciences, Hawaii, HI, USA.10.24251/HICSS.2022.062 ↗
14. Analysis and Classification of Vehicle-Road Collaboration Application Scenarios10.1016/j.procs.2022.10.018 ↗
15. Rau, P.-L.P. (July, January 26). Research on the Trend of Automotive User Experience. Proceedings of the Cross-Cultural Design. Product and Service Design, Mobility and Automotive Design, Cities, Urban Areas, and Intelligent Environments Design, Virtual.
16. (2023, May 23). Haptics|Ultraleap. Available online: https://www.ultraleap.com/haptics/.
17. (2023, June 27). Idrive|Interaction between Driver, Road Infrastructure, Vehicle, and Environment. Available online: https://www.idrive.polimi.it/.
18. (2023, June 27). Unity Real-Time Development Platform|3D, 2D, VR & AR Engine. Available online: https://unity.com.
19. (2023, July 26). Pupil Core—Open Source Eye Tracking Platform—Pupil Labs. Available online: https://pupil-labs.com/products/core/.
20. Trojaniello, D., Cristiano, A., Sanna, A., and Musteata, S. (2018, January 14–18). Evaluating Real-Time Hand Gesture Recognition for Automotive Applications in Elderly Population: Cognitive Load, User Experience and Usability Degree. Proceedings of the Third International Conference on Informatics and Assistive Technologies for Health-Care, Medical Support and Wellbeing HEALTHINFO 2018, Nice, France.
21. A Wearable Vibrotactile Display for Automotive Route Guidance: Evaluating Usability, Workload, Performance and Preference10.1177/1541931215591291 ↗
22. Validation of the Raw National Aeronautics and Space Administration Task Load Index (NASA-TLX) Questionnaire to Assess Perceived Workload in Patient Monitoring Tasks: Pooled Analysis Study Using Mixed Models10.2196/19472 ↗
23. Hassenzahl, M. (, 2004). Mit Dem AttrakDiff Die Attraktivität Interaktiver Produkte Messen. Proceedings of the Usability Professionals UP04, Stuttgart, Germany.
24. Rümelin, S., and Butz, A. (2013, January 28–30). How to Make Large Touch Screens Usable While Driving. Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Eindhoven, The Netherlands.10.1145/2516540.2516557 ↗