Arm Posture Changes and Influences on Hand Controller Interaction Evaluation in Virtual Reality
Source abstract
Abstract
In virtual reality (VR) applications, hand-controller interaction is largely limited by the biomechanical structure of the arm and its kinematical features. Earlier research revealed that different arm postures generate distinct arm fatigue levels in mid-air operational tasks; however, how they impact interaction performance, e.g., accuracy of target grasp and manipulation, has been less investigated. To fill this gap in knowledge, we conducted an empirical experiment in which thirty participants were recruited to complete a series of target acquisition tasks in a specifically designed VR application. Results show that (1) a bent arm posture resulted in a higher interaction accuracy than a stretched arm posture; (2) a downward arm posture interacted more accurately than an upraised arm posture; since two arms are bilaterally symmetric, (3) either selected arm interacted more accurately on the corresponding side than on the opposite side; and (4) the user-preferred or dominant arm interacted more persistently than the non-dominant one, though two arms generated little difference in interaction accuracy. Implications and suggestions are discussed for designing more efficient and user-satisfying interactive spaces in VR.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Virtual Reality Applications and Impacts · Tactile and Sensory Interactions · Interactive and Immersive Displays
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Humanity, Art and Digital Media, Hangzhou Dianzi University, Hangzhou 310018, China
State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, China
Department of Computer and Systems Science, Stockholm University, 10691 Stockholm, Sweden
Funding
National Natural Science Foundation of China · Natural Science Foundation of Zhejiang Province · Philosophy & Social Science Foundation of Zhejiang Province · State Key Laboratory of Virtual Reality Technology and Systems · Science and Technology Bureau of Wenzhou
References (43)
Show source-provided references
1. Effects of virtual reality training on gait biomechanics of individuals post-stroke10.1016/j.gaitpost.2010.01.016 ↗
2. From Visual Simulation to Virtual Reality to Games10.1109/MC.2005.297 ↗
3. Virtual reality and mixed reality for virtual learning environments10.1016/j.cag.2005.10.004 ↗
4. Keil, J., Edler, D., O’Meara, D., Korte, A., and Dickmann, F. (2021). Effects of Virtual Reality Locomotion Techniques on Distance Estimations. ISPRS Int. J. Geo-Inf., 10.10.3390/ijgi10030150 ↗
5. Bonali, F.L., Russo, E., Vitello, F., Antoniou, V., Marchese, F., Fallati, L., Bracchi, V., Corti, N., Savini, A., and Whitworth, M. (2022). How Academics and the Public Experienced Immersive Virtual Reality for Geo-Education. Geosciences, 12.10.3390/geosciences12010009 ↗
6. Talking Realities: Audio Guides in Virtual Reality Visualizations10.1109/MCG.2021.3058129 ↗
7. Using BCI and VR technology in Neurogaming10.1007/978-3-030-30581-9_11 ↗
8. Special Section on touching the 3rd Dimension: A survey of 3D object selection techniques for virtual environments10.1016/j.cag.2012.12.003 ↗
9. Vogel, D., and Balakrishnan, R. (2005, January 23–26). Distant freehand pointing and clicking on very large, high resolution displays. Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, Seattle, WA, USA.10.1145/1095034.1095041 ↗
10. Applied biomechanics of the patella10.1097/00003086-200108000-00003 ↗
11. Balakrishnan, R., and Mackenzie, I.S. (1997, January 22–27). Performance Differences in the Fingers, Wrist, and Forearm in Computer Input Control. Proceedings of the CHI ’97: ACM Conference on Human Factors & Computing Systems, Atlanta Georgia, GA, USA.10.1145/258549.258764 ↗
12. Human Factors in Engineering and Design10.1108/ir.1998.25.2.153.2 ↗
13. Spontaneous alternation of the working arm in static overhead work
14. Hincapié-Ramos, J.D., Guo, X., Moghadasian, P., and Irani, P. (May, January 26). Consumed endurance: A metric to quantify arm fatigue of mid-air interactions. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Toronto, ON, Canada.
15. Fikkert, F.W. (2010). Gesture Interaction at a Distance. [Ph.D. Thesis, University of Twente].
16. Haque, F., Nancel, M., and Vogel, D. (2015, January 18–23). Myopoint: Pointing and Clicking Using Forearm Mounted Electromyography and Inertial Motion Sensors. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Seoul, Korea.10.1145/2702123.2702133 ↗
17. Mine, M.R., Brooks, F.B., and Sequin, C.H. (1997, January 3–8). Moving objects in space: Exploiting proprioception in virtual-environment interaction. Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, Los Angeles, LA, USA.10.1145/258734.258747 ↗
18. Lemmerman, D.K., and LaViola, J.J. (2007, January 10–14). Effects of Interaction-Display Offset on User Performance in Surround Screen Virtual Environments. Proceedings of the IEEE Virtual Reality 2007, Charlotte, NC, USA.10.1109/VR.2007.352513 ↗
19. Boring, S., Jurmu, M., and Butz, A. (2009, January 23–27). Scroll, tilt or move it: Using mobile phones to continuously control pointers on large public displays. Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design, Melbourne, Australia.10.1145/1738826.1738853 ↗
20. Harrison, C., Ramamurthy, S., and Hudson, S.E. (2012, January 19–22). On-body interaction: Armed and dangerous. Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction, Kingston, ON, Canada.10.1145/2148131.2148148 ↗
21. Effects of User’s Hand Orientation and Spatial Movements on Free Hand Interactions with Large Displays10.1080/10447318.2017.1370811 ↗
22. Lou, X., Li, X., Peng, R., and Hansen, P. (2016, January 15–16). Optimising Free Hand Selection in Large Displays by Adapting to User’s Physical Movements. Proceedings of the 2016 ACM Symposium on Spatial User Interaction, Tokyo, Japan.10.1145/2983310.2985754 ↗
23. Poupyrev, I., Billinghurst, M., and Weghorst, S. (1996, January 6–8). The Go-Go Interaction Technique: Non-linear Mapping for Direct Manipulation in VR. Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology, Seattle, WA, USA.10.1145/237091.237102 ↗
24. Jung, W., Cho, W., Kim, H., and Woo, W. (2017, January 9–13). BoostHand: Distance-free Object Manipulation System with Switchable Non-linear Mapping for Augmented Reality Classrooms. Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, Nantes, France.10.1109/ISMAR-Adjunct.2017.96 ↗
25. Ens, B.M., Finnegan, R., and Irani, P.P. (May, January 26). The Personal Cockpit: A Spatial Interface for Effective Task Switching on Head-Worn Displays. Proceedings of the CHI’14: ACM Conference on Human Factors & Computing Systems, Toronto, ON, Canada.
26. Gerber, D., and Bechmann, D. (2005, January 12–16). The spin menu: A menu system for virtual environments. Proceedings of the IEEE Conference on Virtual Reality, Bonn, Germany.
27. Mäkelä, V., Heimonen, T., and Turunen, M. (2014, January 3–4). Magnetic Cursor: Improving Target Selection in Freehand Pointing Interfaces. Proceedings of the International Symposium on Pervasive Displays, Copenhagen, Denmark.10.1145/2611009.2611025 ↗
28. Hand-Adaptive User Interface: Improved Gestural Interaction in Virtual Reality10.1007/s10055-020-00461-7 ↗
29. Cournia, N., Smith, J.D., and Duchowski, A.T. (2003, January 5–10). Gaze- vs. hand-based pointing in virtual environments. Proceedings of the CHI 03 Extended Abstracts on Human Factors in Computing Systems, Fort Lauderdale, FL, USA.10.1145/765891.765982 ↗
30. Chen, X.A., Schwarz, J., Harrison, C., Mankoff, J., and Hudson, S. (2014, January 24–27). Around-body interaction: Sensing & interaction techniques for proprioception-enhanced input with mobile devices. Proceedings of the International Conference on Human-Computer Interaction with Mobile Devices & Services, Toronto, ON, Canada.10.1145/2628363.2628402 ↗
31. Yan, Y., Yu, C., Ma, X., Huang, S., Iqbal, H., and Shi, Y. (2018, January 21–26). Eyes-Free Target Acquisition in Interaction Space around the Body for Virtual Reality. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montréal, QC, Canada.10.1145/3173574.3173616 ↗
32. Air pointing: Design and evaluation of spatial target acquisition with and without visual feedback10.1016/j.ijhcs.2011.02.005 ↗
33. Wang, Y., and MacKenzie, C. (September, January 30). Effects of orientation disparity between haptic and graphic displays of objects in virtual environments. Proceedings of the INTERACT’99, Edinburgh, UK.
34. Lubos, P., Bruder, G., and Steinicke, F. (2014, January 29–30). Analysis of direct selection in head-mounted display environments. Proceedings of the IEEE Symposium on 3D User Interfaces, Minneapolis, MN, USA.10.1109/3DUI.2014.6798834 ↗
35. Lubos, P., Bruder, G., Ariza, O., and Steinicke, F. (2016, January 15–16). Touching the Sphere: Leveraging Joint-Centered Kinespheres for Spatial User Interaction. Proceedings of the 2016 Symposium on Spatial User Interaction, Tokyo, Japan.10.1145/2983310.2985753 ↗
36. The information capacity of the human motor system in controlling the amplitude of movement10.1037/h0055392 ↗
37. Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts’ law research in HCI10.1016/j.ijhcs.2004.09.001 ↗
38. Functional specialization in the lower and upper visual fields in humans: Its ecological origins and neurophysiological implications10.1017/S0140525X00080018 ↗
39. Superior performance for visually guided pointing in the lower visual field10.1007/s002210000653 ↗
40. Po, B.A., Fisher, B.D., and Booth, K.S. (2004, January 24–29). Mouse and touchscreen selection in the upper and lower visual fields. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vienna, Austria.10.1145/985692.985738 ↗
41. The assessment and analysis of handedness: The Edinburgh inventory10.1016/0028-3932(71)90067-4 ↗
42. Development of NASA-TLX (task load index): Results of empirical and theoretical research10.1016/S0166-4115(08)62386-9 ↗
43. The body schema and the multisensory representation(s) of peripersonal space10.1007/s10339-004-0013-3 ↗