Enhancing User Experience in Virtual Museums: Impact of Finger Vibrotactile Feedback
Source abstract
Abstract
Virtual reality (VR) offers immersive visual and auditory experiences, transporting users to alternate realities. However, existing VR systems lack realistic haptic feedback mechanisms, resulting in unsatisfactory immersive experiences. In this study, we developed and tested a haptic glove that simulates realistic tactile sensations, enhancing user interaction with virtual artifacts. Our research investigates the impact of finger-specific vibrotactile feedback (FSVF) on user experience in virtual museum environments. Using a mixed-methods approach, 30 participants engaged in object-manipulation tasks in three settings: no haptic feedback, standard controller feedback, and vibrotactile glove feedback. The findings demonstrate that the vibrotactile glove approach considerably improves user accuracy, efficiency, immersion, and satisfaction compared with other traditional interaction methods. Participants completed tasks more accurately and quickly with the glove, reporting high levels of engagement and immersion. The results highlight the potential of advanced haptic feedback in transforming virtual reality technology, particularly for educational and cultural applications. Further, they provide valuable insights for designing and applying future haptic technology in immersive environments.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Virtual Reality Applications and Impacts · Tactile and Sensory Interactions · Augmented Reality Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Culture and Technology Convergence, Changwon National University, Changwon-si 51140, Gyeongsangnam-do, Republic of Korea
Department of Culture Technology, Changwon National University, Changwon-si 51140, Gyeongsangnam-do, Republic of Korea
Funding
National Research Foundation of Korea (NRF) · Ministry of Education and National Research Foundation of Korea
References (43)
Show source-provided references
1. Perret, J., and Vander Poorten, E. (2018). Touching virtual reality: A review of haptic gloves. ACTUATOR 2018, Proceedings of the 16th International Conference on New Actuators, Bremen, Germany, 25–27 June 2018, VDE.
2. Performance and perception of haptic feedback in a laparoscopic 3D virtual reality simulator10.1080/13645706.2018.1539012 ↗
3. Virtual reality cerebral aneurysm clipping simulation with real-time haptic feedback
4. Haptic preservation of cultural ephemera: An extended reality solution using stereoscopic experience replication for Victorian parlor culture10.56294/mr202348 ↗
5. Kim, M., Jeon, C., and Kim, J. (2017). A study on immersion and presence of a portable hand haptic system for immersive virtual reality. Sensors, 17.10.3390/s17051141 ↗
6. Haptic virtual reality and immersive learning for enhanced organic chemistry instruction10.1007/s10055-018-0345-4 ↗
7. Haptic display for virtual reality: Progress and challenges10.3724/SP.J.2096-5796.2019.0008 ↗
8. Virtual reality simulators for temporal bone dissection: Overcoming limitations of previous models10.21790/rvs.2024.002 ↗
9. Katranitsiotis, P., Zaparas, P., Stavridis, K., and Daras, P. (2024, January 24–26). Leveraging VR and force-haptic feedback for effective training with robots. Proceedings of the 13th International Conference on Pattern Recognition Applications and Methods (ICPRAM 2024), Rome, Italy.10.5220/0012319200003654 ↗
10. The user experience of distal arm-level vibrotactile feedback for interactions with virtual versus physical displays10.1007/s10055-024-00977-2 ↗
11. Pacchierotti, C., Chinello, F., Koumaditis, K., Di Luca, M., Ofek, E., and Georgiou, O. (2024, April 14). Haptics in the Metaverse: Haptic Feedback for Virtual, Augmented, Mixed, and EXtended Realities. IEEE Trans Haptics (ToH). Available online: https://inria.hal.science/hal-04511207.10.1109/TOH.2024.3369192 ↗
12. Evolution and analysis of hapkit: An open-source haptic device for educational applications10.1109/TOH.2019.2948609 ↗
13. Haptic perception, mechanics, and material technologies for virtual reality10.1002/adfm.202008186 ↗
14. Dickinson, K. (2024, March 12). We Tested the Most Advanced Haptic Gloves in the World. Available online: https://www.freethink.com/ar-vr/we-tested-the-most-advanced-haptic-gloves-in-the-world.
15. Benko, H., Holz, C., Sinclair, M., and Ofek, E. (2016, January 16–19). Normal touch and texture touch: High-fidelity 3d haptic shape rendering on handheld virtual reality controllers. Proceedings of the 29th Annual Symposium on User Interface Software and Technology, Tokyo, Japan.10.1145/2984511.2984526 ↗
16. Carter, R. (2024, March 12). The Best VR Gloves in 2024: Harnessing Haptic Feedback. Available online: https://www.xrtoday.com/virtual-reality/the-best-vr-gloves-in-2024-harnessing-haptic-feedback/.
17. Han, P.H., Chen, Y.S., Lee, K.C., Wang, H.C., Hsieh, C.E., Hsiao, J.C., Chou, C.H., and Hung, Y.P. (December, January 28). Haptic around multiple tactile sensations for immersive environment and interaction in virtual reality. Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, Tokyo, Japan.
18. Reality skins: Creating immersive and tactile virtual environments
19. Schorr, S.B., and Okamura, A.M. (2017, January 6–11). Fingertip tactile devices for virtual object manipulation and exploration. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, USA.10.1145/3025453.3025744 ↗
20. An initial exploration of a multi-sensory design space: Tactile support for walking in immersive virtual environments10.1109/3DUI.2016.7460037 ↗
21. An empirical evaluation of visuo-haptic feedback on physical reaching behaviors during 3D interaction in real and immersive virtual environments10.1145/2947617 ↗
22. Comparative analysis of interaction techniques in virtual reality
23. Not just seeing, but also feeling art: Mid-air haptic experiences integrated in a multisensory art exhibition10.1016/j.ijhcs.2017.06.004 ↗
24. Taylor, R., Bowers, J., Nissen, B., Wood, G., Chaudhry, Q., Wright, P., Bruce, L., Glynn, S., Mallinson, H., and Bearpark, R. (2015, January 22–25). Making magic: Designing for open interactions in museum settings. Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition, Glasgow, UK.10.1145/2757226.2757241 ↗
25. Impact of interactive technologies on stimulating learning experiences in a museum10.1016/j.im.2016.10.004 ↗
26. A survey on haptic technologies for mobile augmented reality10.1145/3465396 ↗
27. Lack of transfer of skills after virtual reality simulator training with haptic feedback10.1080/13645706.2017.1319866 ↗
28. Chatterjee, H. (2020). Touch in Museums: Policy and Practice in Object Handling, Routledge.
29. Sharp, T., Keskin, C., Robertson, D., Taylor, J., Shotton, J., Kim, D., Rhemann, C., Leichter, I., Vinnikov, A., and Wei, Y. (2015, January 18–23). Accurate, robust, and flexible real-time hand tracking. Proceedings of the 33rd Annual A.C.M. Conference on Human Factors in Computing Systems, Seoul, Republic of Korea.10.1145/2702123.2702179 ↗
30. Soli: Ubiquitous gesture sensing with millimeter wave radar10.1145/2897824.2925953 ↗
31. Mueller, F., Bernard, F., Sotnychenko, O., Mehta, D., Sridhar, S., Casas, D., and Theobalt, C. (2018, January 18–23). Generated hands for real-time 3d hand tracking from monocular rgb. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00013 ↗
32. Simon, T., Joo, H., Matthews, I., and Sheikh, Y. (2017, January 21–26). Hand keypoint detection in single images using multiview bootstrapping. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.494 ↗
33. Wang, P., Wu, P., Wang, J., Chi, H.L., and Wang, X. (2018). A critical review of the use of virtual reality in construction engineering education and training. Int. J. Environ. Res. Public. Health, 15.10.3390/ijerph15061204 ↗
34. Ravichandran, G., Choi, H., Ha, C., and Nam, S. (2024, January 24–26). Haptic Gloves Create Realism in a VR Experience in the Virtual Museum. Proceedings of the HCI Korea Conference, Hongcheon, Republic of Korea.
35. Chapman, A. (2019). Haptic Feedback in Virtual Reality: An Investigation into the Next Step of First-Person Perspective Presence. [Ph.D. Thesis, University of Lincoln].
36. Likert, R. (1932). A Technique for the Measurement of Attitude Scales, Archives of Psychology.
37. Fine tactile representation of materials for virtual reality10.1155/2020/7296204 ↗
38. SPSS, and IBM Corp (Released, Statistics for Windows, 2017). Released, Statistics for Windows, version 25.0.
39. Moon, H.S. (2022). The Effect of Interaction Method and Vibrotactile Feedback on User Experience and Performance in the VR Games. [Ph.D. Thesis, Virginia Tech]. Available online: http://hdl.handle.net/10919/110151.
40. Oakley, I., Brewster, S., and Gray, P. (2001). Solving multi-target haptic problems in menu interaction. CHI’01 Extended Abstracts on Human Factors in Computing Systems, Association for Computing Machiner.10.1145/634067.634278 ↗
41. A comparison of the effects of haptic and visual feedback on presence in virtual reality10.1016/j.ijhcs.2021.102717 ↗
42. Hand tracking with vibrotactile feedback enhanced presence, engagement, usability, and performance in a virtual reality rhythm game10.1080/10447318.2022.2087000 ↗
43. A thermal and vibrational feedback glove based on the tactile characteristics of human hand skin10.1109/ACCESS.2020.3045614 ↗