Effect of Target Size, Location, and Input Method on Interaction in Immersive Virtual Reality
Source abstract
Abstract
Although new virtual reality (VR) devices and their contents are actively being released, there are still not enough studies to prepare its interface/interaction standard. In this study, it was investigated whether specific interaction factors influenced task performance and the degree of virtual reality sickness when performing pointing tasks in immersive virtual reality. A smartphone-based VR device was used, and twenty-five targets were placed in a 5 × 5 layout on the VR experimental area that extended to a range similar to the human viewing angle. Task completion time (TCT) was significantly affected by target selection method (p < 0.001) and target size (p < 0.001), whereas the error rate (ER) significantly differed for the target selection method (p < 0.001) and not for the target size (p = 0.057). Target location was observed to be a factor affecting TCT (p < 0.001), but it did not affect the ER (p = 0.876). VR sickness was more severe when the target size was smaller. Gaze selection was found to be more efficient when accuracy is demanded, and manual selection is more efficient for quick selection. Moreover, applying these experimental data to Fitts’ Law showed that the movement time was found to be less affected by the device when using the gaze-selection method. Virtual reality provides a three-dimensional visual environment, but a one-dimensional formula can sufficiently predict the movement time. The result of this study is expected to be a reference for preparing interface/interaction design standards for virtual reality.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Virtual Reality Applications and Impacts · Interactive and Immersive Displays · Tactile and Sensory Interactions
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Industrial & Management Engineering, Incheon National University, Incheon 22012, Korea
School of Information Convergence, Kwangwoon University, Seoul 01897, Korea
Funding
Incheon National University
References (63)
Show source-provided references
1. Porcino, T.M., Clua, E., Trevisan, D., Vasconcelos, C.N., and Valente, L. (2017, January 2–4). Minimizing cyber sickness in head mounted display systems: Design guidelines and applications. Proceedings of the 2017 IEEE 5th International Conference on Serious Games and Applications for Health (SeGAH), Perth, WA, Australia.10.1109/SeGAH.2017.7939283 ↗
2. Waltemate, T., Senna, I., Hülsmann, F., Rohde, M., Kopp, S., Ernst, M., and Botsch, M. (2016, January 2–4). The impact of latency on perceptual judgments and motor performance in closed-loop interaction in virtual reality. Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology, Munich, Germany.10.1145/2993369.2993381 ↗
3. Cevette, M., Stepanek, J., and Galea, A. (2014). Galvanic Vestibular Stimulation System and Method of Use for Simulation, Directional Cueing, and Alleviating Motion-Related Sickness. (8,718,796), Google Patent.
4. Ruddle, R.A. (2004, January 27–31). The effect of environment characteristics and user interaction on levels of virtual environment sickness. Proceedings of the IEEE Virtual Reality 2004, Chicago, IL, USA.
5. Simulator sickness depends on frequency of the simulator motion mismatch: An observation10.1162/pres.17.6.584 ↗
6. Lu, D. (2016). Virtual Reality Sickness during Immersion: An Investigation of Potential Obstacles towards General Accessibility of VR Technology. [Master’s Thesis, Uppsala University].
7. Marks, S., Estevez, J.E., and Connor, A.M. (2014, January 19–21). Towards the Holodeck: Fully immersive virtual reality visualisation of scientific and engineering data. Proceedings of the 29th International Conference on Image and Vision Computing New Zealand, Hamilton, New Zealand.10.1145/2683405.2683424 ↗
8. Hou, X., Lu, Y., and Dey, S. (August, January 31). Wireless VR/AR with edge/cloud computing. Proceedings of the 2017 26th International Conference on Computer Communication and Networks (ICCCN), Vancouver, BC, Canada.10.1109/ICCCN.2017.8038375 ↗
9. Wagner, D. (2021, October 13). Motion-to-Photon Latency in Mobile AR and VR. Available online: https://medium.com/@DAQRI/motion-to-photon-latency-in-mobile-ar-and-vr-99f82c480926.
10. Kundu, R.K., Rahman, A., and Paul, S. (2021). A Study on Sensor System Latency in VR Motion Sickness. J. Sens. Actuator Netw., 10.10.3390/jsan10030053 ↗
11. Blum, T., Wieczorek, M., Aichert, A., Tibrewal, R., and Navab, N. (2010, January 13–16). The effect of out-of-focus blur on visual discomfort when using stereo displays. Proceedings of the 2010 IEEE International Symposium on Mixed and Augmented Reality, Seoul, Korea.10.1109/ISMAR.2010.5643544 ↗
12. Reducing visual discomfort with HMDs using dynamic depth of field10.1109/MCG.2015.98 ↗
13. Fernandes, A.S., and Feiner, S.K. (2016, January 19–20). Combating VR sickness through subtle dynamic field-of-view modification. Proceedings of the 2016 IEEE Symposium on 3D User Interfaces (3DUI), Greenville, SC, USA.10.1109/3DUI.2016.7460053 ↗
14. Wienrich, C., Weidner, C.K., Schatto, C., Obremski, D., and Israel, J.H. (2018, January 5–7). A virtual nose as a rest-frame-the impact on simulator sickness and game experience. Proceedings of the 2018 10th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games), Würzburger, BY, Germany.10.1109/VS-Games.2018.8493408 ↗
15. Buhler, H., Misztal, S., and Schild, J. (2018, January 18–22). Reducing vr sickness through peripheral visual effects. Proceedings of the 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Tuebingen/Reutlingen, Germany.10.1109/VR.2018.8446346 ↗
16. Whittinghill, D.M., Ziegler, B., Case, T., and Moore, B. (2015, January 2–6). Nasum virtualis: A simple technique for reducing simulator sickness. Proceedings of the Games Developers Conference (GDC), San Francisco, CA, USA.
17. Won, J.-H., and Kim, Y.S. (2021). A Study on Visually Induced VR Reduction Method for Virtual Reality Sickness. Appl. Sci., 11.10.3390/app11146339 ↗
18. Kim, J.-Y., Son, J.-B., Leem, H.-S., and Lee, S.-H. (2019). Psychophysiological alteration after virtual reality experiences using smartphone-assisted head mount displays: An EEG-based source localization study. Appl. Sci., 9.10.3390/app9122501 ↗
19. Grassini, S., Laumann, K., and Luzi, A.K. (2021). Association of Individual Factors with Simulator Sickness and Sense of Presence in Virtual Reality mediated by head-mounted displays (HMDs). Multimodal Technol. Interact., 5.10.3390/mti5030007 ↗
20. Effects of a target movement direction cue on head-tracking performance10.1080/001401300184468 ↗
21. Fitts’ Law in Two dimensions with hand and head movements movements10.1080/00222895.1985.10735338 ↗
22. Borah, J. (1995). Investigation of Eye and Head Controlled Cursor Positioning Techniques, Applied Science Labs.
23. Johnsgard, T. (1994, January 18–20). Fitts’ Law with a virtual reality glove and a mouse: Effects of gain. Proceedings of the Graphics Interface, Canadian Information Processing Society, Banff, Alberta, Canada.
24. Assessing the use of immersive virtual reality, mouse and touchscreen in pointing and dragging-and-dropping tasks among young, middle-aged and older adults10.1016/j.apergo.2017.03.013 ↗
25. D’Errico, F., Leone, G., Schmid, M., and D’Anna, C. (2020). Prosocial virtual reality, empathy, and EEG measures: A pilot study aimed at monitoring emotional processes in intergroup helping behaviors. Appl. Sci., 10.10.3390/app10041196 ↗
26. Presence and emotions in virtual environments: The influence of stereoscopy10.1089/cpb.2007.9936 ↗
27. The impact of perception and presence on emotional reactions: A review of research in virtual reality10.3389/fpsyg.2015.00026 ↗
28. Cournia, N., Smith, J.D., and Duchowski, A.T. (2003, January 5–10). Gaze-vs. hand-based pointing in virtual environments. Proceedings of the CHI’03 Extended Abstracts on Human Factors in Computing Systems, Ft. Lauderdale, FL, USA.10.1145/765891.765982 ↗
29. Piumsomboon, T., Lee, G., Lindeman, R.W., and Billinghurst, M. (2017, January 18–19). Exploring natural eye-gaze-based interaction for immersive virtual reality. Proceedings of the 2017 IEEE Symposium on 3D User Interfaces (3DUI), Los Angeles, CA, USA.10.1109/3DUI.2017.7893315 ↗
30. Lyons, D.M. (2001). System and Method for Permitting Three-Dimensional Navigation through a Virtual Reality Environment Using Camera-Based Gesture Inputs. (6,181,343), Google Patents.
31. Saenz-de-Urturi, Z., and Garcia-Zapirain Soto, B. (2016). Kinect-based virtual game for the elderly that detects incorrect body postures in real time. Sensors, 16.10.3390/s16050704 ↗
32. Kim, S., and Kim, G.J. (2004, January 16–18). Using keyboards with head mounted displays. Proceedings of the 2004 ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry, Singapore.10.1145/1044588.1044662 ↗
33. Scheggi, S., Meli, L., Pacchierotti, C., and Prattichizzo, D. (2015, January 9–13). Touch the virtual reality: Using the leap motion controller for hand tracking and wearable tactile devices for immersive haptic rendering. Proceedings of the ACM SIGGRAPH 2015 Posters, Los Angeles, CA, USA.10.1145/2787626.2792651 ↗
34. Khademi, M., Mousavi Hondori, H., McKenzie, A., Dodakian, L., Lopes, C.V., and Cramer, S.C. (May, January 26). Free-hand interaction with leap motion controller for stroke rehabilitation. Proceedings of the CHI’14 Extended Abstracts on Human Factors in Computing Systems, Toronto, ON, Canada.
35. Sidorakis, N., Koulieris, G.A., and Mania, K. (2015, January 23). Binocular eye-tracking for the control of a 3D immersive multimedia user interface. Proceedings of the 2015 IEEE 1St workshop on everyday virtual reality (WEVR), Arles, Bouches-du-Rhône, France.10.1109/WEVR.2015.7151689 ↗
36. The information capacity of the human motor system in controlling the amplitude of movement10.1037/h0055392 ↗
37. Welford, A.T. (1968). Fundamentals of Skill, Methuen & Co Ltd.
38. Fitts’ law as a research and design tool in human-computer interaction10.1207/s15327051hci0701_3 ↗
39. Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys for text selection on a CRT10.1080/00140137808931762 ↗
40. Epps, B.W. Comparison of six cursor control devices based on Fitts’ law models. Proceedings of the Human Factors Society Annual Meeting.
41. Poupyrev, I., Okabe, M., and Maruyama, S. (2004, January 24–29). Haptic feedback for pen computing: Directions and strategies. Proceedings of the CHI’04 Extended Abstracts on Human Factors in Computing Systems, Vienna, Austria.10.1145/985921.986051 ↗
42. Standing at a kiosk: Effects of key size and spacing on touch screen numeric keypad performance and user preference10.1080/00140130410001724228 ↗
43. Parhi, P., Karlson, A.K., and Bederson, B.B. (2006, January 12–15). Target size study for one-handed thumb use on small touchscreen devices. Proceedings of the 8th Conference on Human-Computer Interaction with Mobile Devices and Services, Helsinki, Finland.10.1145/1152215.1152260 ↗
44. Touch key design for one-handed thumb interaction with a mobile phone: Effects of touch key size and touch key location10.1016/j.ergon.2009.08.002 ↗
45. Crossman, E.R. (1956). The Measurement of Perceptual Load in Manual Operations. University of Birmingham.
46. MacKenzie, I.S., and Buxton, W. (1992, January 3–7). Extending Fitts’ law to two-dimensional tasks. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Monterey, CA, USA.10.1145/142750.142794 ↗
47. Effect of varying target height in a Fitts’ movement task10.1080/00140139408963719 ↗
48. Extending Fitts’ law to a three-dimensional pointing task10.1016/S0167-9457(01)00058-6 ↗
49. Extended Fitts’ law for 3D pointing tasks using 3D target arrangements10.1016/j.ergon.2013.05.005 ↗
50. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness10.1207/s15327108ijap0303_3 ↗
51. Virtual reality sickness questionnaire (VRSQ): Motion sickness measurement index in a virtual reality environment10.1016/j.apergo.2017.12.016 ↗
52. Age-related differences with immersive and non-immersive virtual reality in memory assessment10.3389/fpsyg.2019.01330 ↗
53. Gough, C. (2021, October 13). VR and AR Ownership and Purchase Intent among U.S. Consumers 2017, by Age. Available online: https://www.statista.com/statistics/740760/vr-ar-ownership-usa-age/.
54. Font size and viewing distance of handheld smart phones10.1097/OPX.0b013e3182198792 ↗
55. Effect of touch screen button size and spacing on touch characteristics of users with and without disabilities10.1177/0018720811433831 ↗
56. Effect of tactile feedback for button GUI on mobile touch devices10.4218/etrij.14.0114.0028 ↗
57. Comparison of gaze cursor input methods for virtual reality devices10.1080/10447318.2018.1484054 ↗
58. Analyzing thumb interaction on mobile touchpad devices10.1016/j.ergon.2018.05.018 ↗
59. Does the Hand Anthropometric Dimension Influence Touch Interaction?
60. Lin, J.-W., Duh, H.B.-L., Parker, D.E., Abi-Rached, H., and Furness, T.A. (2002, January 24–28). Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment. Proceedings of the IEEE Virtual Reality, Orlando, FL, USA.
61. Factors associated with virtual reality sickness in head-mounted displays: A systematic review and meta-analysis10.3389/fnhum.2020.00096 ↗
62. Hakkinen, J., Vuori, T., and Paakka, M. (2002, January 6–9). Postural stability and sickness symptoms after HMD use. Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Yasmine Hammamet, Tunisia.
63. Arns, L.L., and Cerney, M.M. (2005, January 12–16). The relationship between age and incidence of cybersickness among immersive environment users. Proceedings of the IEEE Proceedings. VR 2005. Virtual Reality, Bonn, North Rhine-Westphalia, Germany.