Manipulating Underfoot Tactile Perceptions of Flooring Materials in Augmented Virtuality
Source abstract
Abstract
Underfoot haptics, a largely unexplored area, offers rich tactile information close to that of hand-based interactions. Haptic feedback gives a sense of physicality to virtual environments, making for a more realistic and immersive experience. Augmented Virtuality offers the ability to render virtual materials on a physical object, or haptic proxy, without the user being aware of the object’s physical appearance while seeing their own body. In this research, we investigate how the visual appearance of physical objects can be altered virtually to impact the tactile perception of the object. An Augmented Virtuality system was developed to explore this, and two tactile perception experiments, consisting of 18 participants, were conducted. Specifically, we explore whether changing the visual appearance of materials affects a person’s underfoot tactile perception and which tactile perception is most affected by the change through a within-subjects experiment. Additionally, the study examines whether people are aware of changes in visual appearance when focused on other tasks through a between-subjects experiment. The study showed that a change in visual appearance significantly impacts the tactile perception of roughness. Matching visual appearance to physical materials was found to increase awareness of tactile perception.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Tactile and Sensory Interactions · Multisensory perception and integration · Visual perception and processing mechanisms
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Product Design, University of Canterbury, Christchurch 8041, New Zealand
HIT Lab NZ, University of Canterbury, Christchurch 8041, New Zealand
References (58)
Show source-provided references
1. Strandholt, P.L., Dogaru, O.A., Nilsson, N.C., Nordahl, R., and Serafin, S. (2020, January 25–30). Knock on wood: Combining redirected touching and physical props for tool-based interaction in virtual reality. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.10.1145/3313831.3376303 ↗
2. Cheng, L.P., Chang, L., Marwecki, S., and Baudisch, P. (2018, January 21–26). iturk: Turning passive haptics into active haptics by making users reconfigure props in virtual reality. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada.10.1145/3173574.3173663 ↗
3. Teng, S.Y., Li, P., Nith, R., Fonseca, J., and Lopes, P. (2021, January 8–13). Touch&Fold: A Foldable Haptic Actuator for Rendering Touch in Mixed Reality. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, CHI ’21, Virtual.10.1145/3411764.3445099 ↗
4. Zenner, A., and Krüger, A. (2019, January 4–9). Drag: On: A virtual reality controller providing haptic feedback based on drag and weight shift. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK.10.1145/3290605.3300441 ↗
5. McClelland, J.C., Teather, R.J., and Girouard, A. (2017, January 16–17). Haptobend: Shape-changing passive haptic feedback in virtual reality. Proceedings of the 5th Symposium on Spatial User Interaction, Brighton, UK.10.1145/3131277.3132179 ↗
6. Hwang, I., Son, H., and Kim, J.R. (2017, January 6–9). AirPiano: Enhancing Music Playing Experience in Virtual Reality with Mid-Air Haptic Feedback. Proceedings of the 2017 IEEE World Haptics Conference (WHC), Munich, Germany.10.1109/WHC.2017.7989903 ↗
7. AIREAL: Interactive tactile experiences in free air10.1145/2461912.2462007 ↗
8. Bau, O., Poupyrev, I., Israr, A., and Harrison, C. (2010, January 3–6). Teslatouch: Electrovibration for Touch Surfaces. Proceedings of the UIST ’10: 23rd Annual ACM Symposium on User Interface Software and Technology, New York, NY, USA.10.1145/1866029.1866074 ↗
9. Augmenting Perceived Softness of Haptic Proxy Objects Through Transient Vibration and Visuo-Haptic Illusion in Virtual Reality10.1109/TVCG.2020.3002245 ↗
10. Yem, V., Okazaki, R., and Kajimoto, H. (2016, January 8–11). Vibrotactile and pseudo force presentation using motor rotational acceleration. Proceedings of the 2016 IEEE Haptics Symposium (HAPTICS), Philadelphia, PA, USA.10.1109/HAPTICS.2016.7463154 ↗
11. Simeone, A.L., Velloso, E., and Gellersen, H. (2015, January 18–23). Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI ’15, Seoul, Republic of Korea.10.1145/2702123.2702389 ↗
12. Visual perception of materials and their properties10.1016/j.visres.2013.11.004 ↗
13. Visual dominance: An information-processing account of its origins and significance10.1037/0033-295X.83.2.157 ↗
14. Haptic and visual perception of roughness10.1016/j.actpsy.2006.03.002 ↗
15. Visual and haptic representations of material properties10.1163/22134808-00002429 ↗
16. Vision and touch: Independent or integrated systems for the perception of texture?10.1016/j.brainres.2008.05.037 ↗
17. Hirano, Y., Kimura, A., Shibata, F., and Tamura, H. (2011, January 19–23). Psychophysical influence of mixed-reality visual stimulation on sense of hardness. Proceedings of the 2011 IEEE Virtual Reality Conference, Singapore.10.1109/VR.2011.5759436 ↗
18. Softar: Visually manipulating haptic softness perception in spatial augmented reality10.1109/TVCG.2015.2459792 ↗
19. Benko, H., Holz, C., Sinclair, M., and Ofek, E. (2016, January 16–19). Normaltouch and texturetouch: High-fidelity 3d haptic shape rendering on handheld virtual reality controllers. Proceedings of the 29th Annual Symposium on User Interface Software and Technology, Tokyo, Japan.10.1145/2984511.2984526 ↗
20. Choi, I., Culbertson, H., Miller, M.R., Olwal, A., and Follmer, S. (2017, January 22–25). Grabity: A wearable haptic interface for simulating weight and grasping in virtual reality. Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, Quebec, QC, Canada.10.1145/3126594.3126599 ↗
21. Murakami, T., Person, T., Fernando, C.L., and Minamizawa, K. (August, January 30). Altered touch: Miniature haptic display with force, thermal and tactile feedback for augmented haptics. Proceedings of the SIGGRAPH ’17: ACM SIGGRAPH 2017 Emerging Technologies, Los Angeles, CA, USA.10.1145/3084822.3084836 ↗
22. Individual differences in perceptual space for tactile textures: Evidence from multidimensional scaling10.3758/BF03212154 ↗
23. Perceptual dimensions of tactile surface texture: A multidimensional scaling analysis10.3758/BF03211795 ↗
24. Exploring Relationships between Touch Perception and Surface Physical Properties
25. Psychophysical Dimensions of Tactile Perception of Textures10.1109/TOH.2012.32 ↗
26. Exploring Tactile Perceptual Dimensions Using Materials Associated with Sensory Vocabulary10.3389/fpsyg.2017.00569 ↗
27. Cues for Haptic Perception of Compliance10.1109/TOH.2009.16 ↗
28. Tactile properties of fabrics
29. Why is there so much more research on vision than on any other sensory modality?10.3389/fpsyg.2019.02246 ↗
30. Visual and tactual texture perception: Intersensory cooperation10.3758/BF03202657 ↗
31. Altering User Movement Behaviour in Virtual Environments10.1109/TVCG.2017.2657038 ↗
32. Effects of visual and auditory cues on haptic illusions for active and passive touches in mixed reality10.1016/j.ijhcs.2021.102613 ↗
33. Role of tactile and visual inputs in product evaluation: A multisensory perspective10.1108/13555851111165066 ↗
34. lesaki, A., Somada, A., Kimura, A., Shibata, F., and Tamura, H. (2008, January 8–12). Psychophysical Influence on Tactual Impression by Mixed-Reality Visual Stimulation. Proceedings of the 2008 IEEE Virtual Reality Conference, Reno, NV, USA.10.1109/VR.2008.4480793 ↗
35. Altering the Stiffness, Friction, and Shape Perception of Tangible Objects in Virtual Reality Using Wearable Haptics10.1109/TOH.2020.2967389 ↗
36. AR feels “softer” than VR: Haptic perception of stiffness in augmented versus virtual reality10.1109/TVCG.2017.2735078 ↗
37. Kitahara, I., Nakahara, M., and Ohta, Y. (2012). Advances in Haptics, IntechOpen.
38. Günther, S., Rasch, J., Schön, D., Müller, F., Schmitz, M., Riemann, J., Matviienko, A., and Mühlhäuser, M. Proceedings of the CHI ’22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems.
39. Purves, D., Augustine, G.J., Fitzpatrick, D., Hall, W., LaMantia, A.S., and White, L. (2019). Neurosciences, De Boeck Supérieur.
40. Whole-Body Mapping of Spatial Acuity for Pain and Touch10.1002/ana.24179 ↗
41. Schmidt, D., Kovacs, R., Mehta, V., Umapathi, U., Köhler, S., Cheng, L.P., and Baudisch, P. (2015, January 18–23). Level-Ups: Motorized Stilts that Simulate Stair Steps in Virtual Reality. Proceedings of the 33rd Annual ACM Conference, Seoul, Republic of Korea.10.1145/2702123.2702253 ↗
42. Yokota, T., Ohtake, M., Nishimura, Y., Yui, T., Uchikura, R., and Hashida, T. (2015, January 9–11). Snow Walking: Motion-Limiting Device That Reproduces the Experience of Walking in Deep Snow. Proceedings of the 6th Augmented Human International Conference AH ’15, Singapore.10.1145/2735711.2735829 ↗
43. Design of Variable-Friction Devices for Shoe-Floor Contact10.1016/j.mechatronics.2017.07.005 ↗
44. FrictShoes: Providing Multilevel Nonuniform Friction Feedback on Shoes in VR10.1109/TVCG.2022.3150492 ↗
45. Visell, Y., Cooperstock, J.R., Giordano, B.L., Franinovic, K., Law, A., Mcadams, S., Jathal, K., and Fontana, F. (2008, January 10–13). A Vibrotactile Device for Display of Virtual Ground Materials in Walking. Proceedings of the 6th International Conference on Haptics: Perception, Devices and Scenarios, EuroHaptics ’08, Madrid, Spain.
46. Hansen, K.L., Jensen, U.S., Johansson, S.P., Papachristos, E., Skov, M.B., Vertegaal, R., and Merritt, T. (2022, January 8–12). FeetBack: Providing Haptic Directional Cues Through a Shape-changing Floor. Proceedings of the Nordic Human-Computer Interaction Conference, Aarhus, Denmark.10.1145/3546155.3546653 ↗
47. Propelwalker: A leg-based wearable system with propeller-based force feedback for walking in fluids in vr10.1109/TVCG.2022.3205181 ↗
48. GroundFlow: Liquid-based Haptics for Simulating Fluid on the Ground in Virtual Reality10.1109/TVCG.2023.3247073 ↗
49. Nilsson, N.C., Nordahl, R., Turchet, L., and Serafin, S. (2012, January 23–24). Audio-Haptic Simulation of Walking on Virtual Ground Surfaces to Enhance Realism. Proceedings of the HAID 2012: Haptic and Audio Interaction Design, Lund, Sweden.10.1007/978-3-642-32796-4_7 ↗
50. Nordahl, R., Berrezag, A., Dimitrov, S., Turchet, L., Hayward, V., and Serafin, S. (2010, January 8–10). Preliminary Experiment Combining Virtual Reality Haptic Shoes and Audio Synthesis. Proceedings of the EuroHaptics 2010: Haptics: Generating and Perceiving Tangible Sensations, Amsterdam, The Netherlands.10.1007/978-3-642-14075-4_18 ↗
51. Haptic Feedback for Enhancing Realism of Walking Simulations10.1109/TOH.2012.51 ↗
52. Lee, C.J., Tsai, H.R., and Chen, B.Y. (2021, January 8–13). HairTouch: Providing Stiffness, Roughness and Surface Height Differences Using Reconfigurable Brush Hairs on a VR Controller. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, CHI ’21, Virtual.10.1145/3411764.3445285 ↗
53. Degraen, D., Zenner, A., and Krüger, A. (2019, January 4–9). Enhancing Texture Perception in Virtual Reality Using 3D-Printed Hair Structures. Proceedings of the CHI ’19: CHI Conference on Human Factors in Computing Systems, Glasgow, UK.10.1145/3290605.3300479 ↗
54. Wobbrock, J.O., Findlater, L., Gergle, D., and Higgins, J.J. (2011, January 7–12). The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vancouver, BC, Canada. CHI ’11.10.1145/1978942.1978963 ↗
55. Elkin, L.A., Kay, M., Higgins, J.J., and Wobbrock, J.O. (2021, January 10–14). An aligned rank transform procedure for multifactor contrast tests. Proceedings of the The 34th Annual ACM Symposium on User Interface Software and Technology, Virtual.10.1145/3472749.3474784 ↗
56. (2022, June 18). Igroup Presence Questionnaire (IPQ) Overview. Available online: https://www.igroup.org/pq/ipq/download.php.
57. Two hands, one perception: How bimanual haptic information is combined by the brain10.1152/jn.00756.2010 ↗
58. Assimilation of virtual legs and perception of floor texture by complete paraplegic patients receiving artificial tactile feedback10.1038/srep32293 ↗