3D User Interface Design and Usability for Immersive VR
Source abstract
Abstract
This work presents a novel design of a new 3D user interface for an immersive virtual reality desktop and a new empirical analysis of the proposed interface using three interaction modes. The proposed novel dual-layer 3D user interface allows for user interactions with multiple screens portrayed within a curved 360-degree effective field of view available for the user. Downward gaze allows the user to raise the interaction layer that facilitates several traditional desktop tasks. The 3D user interface is analyzed using three different interaction modes, point-and-click, controller-based direct manipulation, and a gesture-based user interface. A comprehensive user study is performed within a mixed-methods approach for the usability and user experience analysis of all three user interaction modes. Each user interaction is quantitatively and qualitatively analyzed for simple and compound tasks in both standing and seated positions. The crafted mixed approach for this study allows to collect, evaluate, and validate the viability of the new 3D user interface. The results are used to draw conclusions about the suitability of the interaction modes for a variety of tasks in an immersive Virtual Reality 3D desktop environment.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Virtual Reality Applications and Impacts · Tactile and Sensory Interactions · Interactive and Immersive Displays
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science, University of Sharjah, University of Sharjah, Sharjah P.O. Box 27272, UAE
References (37)
Show source-provided references
1. Bowman, D., Kruijff, E., LaViola, J., McMahan, R.P., and Poupyrev, I. (2017). 3D User Interfaces: Theory and Practice, Addison-Wesley Professional. [2nd ed.].
2. Re, G.M., and Bordegoni, M. (2014). A Natural User Interface for Navigating in Organized 3D Virtual Contents. International Conference on Virtual, Augmented and Mixed Reality, Springer International Publishing.10.1007/978-3-319-07458-0_10 ↗
3. Saffer, D. (2008). Designing Gestural Interfaces: Touchscreens and Interactive Devices, O’Reilly Media, Inc.
4. A review of vision-based hand gestures recognition
5. Jerald, J.J. (2009). Scene-Motion-and Latency-Perception Thresholds for Head-Mounted Displays. [Ph.D Thesis, University of North Carolina at Chapel Hill].10.1109/VR.2009.4811025 ↗
6. Kaushik, M., and Jain, R. (2014). Natural user interfaces: Trend in virtual interaction. arXiv.
7. Ahn, S.C., Lee, T., Kim, I., Kwon, Y., and Kim, H. (2004, January 27–30). Computer Vision based Interactive Presentation System. Proceedings of the Asian Conference for Computer Vision, Jeju, Korea.
8. Pang, Y.Y., Ismail, N.A., and Gilbert, P.L.S. (2010, January 26–28). A real time vision-based hand gesture interaction. Proceedings of the Fourth Asia International Conference on Mathematical/Analytical Modelling and Computer Simulation (AMS), Bornea, Malaysia.10.1109/AMS.2010.55 ↗
9. A study on the control method of 3-dimensional space application using kinect system
10. Bragdon, A., DeLine, R., Hinckley, K., and Morris, M.R. (2011, January 13–16). Code space: Touch+ air gesture hybrid interactions for supporting developer meetings. Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, Kobe, Japan.10.1145/2076354.2076393 ↗
11. You can’t touch this: Touch-free navigation through radiological images10.1177/1553350611425508 ↗
12. Manipulation of virtual objects through a LeapMotion optical sensor
13. Fanini, B. (2014, January 23–27). A 3D interface to explore and manipulate multi-scale virtual scenes using the leap motion controller. Proceedings of the Seventh International Conference on Advances in Computer-Human Interactions (ACHI 2014), Barcelona, Spain.
14. Kry, P., Pihuit, A., Bernhardt, A., and Cani, M. (2008, January 27–29). Handnavigator: Hands-on interaction for desktop virtual reality. Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology, Bordeaux, France.10.1145/1450579.1450591 ↗
15. Balaa, E., Raynal, M., Bou Issa, Y., and Dubois, E. (2014). Classification of Interaction Techniques in the 3D Virtual Environment on Mobile Devices. International Conference on Virtual, Augmented and Mixed Reality, Springer International Publishing.10.1007/978-3-319-07458-0_1 ↗
16. Song, J., Soros, G., Pece, F., Fanello, S., Izadi, S., Keskin, C., and Hilliges, O. (2009, January 27–29). In-air gestures around unmodified mobile devices. Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, Bordeaux, France.
17. Designing the user interface for multimodal speech and pen-based gesture applications: State-of-the-art systems and future research directions10.1207/S15327051HCI1504_1 ↗
18. Chatterjee, I., Xiao, R., and Harrison, C. (2015, January 9–13). Gaze+ gesture: Expressive, precise and targeted free-space interactions. Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, Seattle, WA, USA.10.1145/2818346.2820752 ↗
19. Zhang, Y., Stellmach, S., Sellen, A., and Blake, A. (2015). The costs and benefits of combining gaze and hand gestures for remote interaction. Human-Computer Interaction, Springer.10.1007/978-3-319-22698-9_39 ↗
20. Villaroman, N., Rowe, D., and Swan, B. (2012, January 11–13). Teaching natural user interaction using OpenNI and the Microsoft Kinect sensor. Proceedings of the 2011 Conference on Information Technology Education, Calgary, AB, Canada.10.1145/2047594.2047654 ↗
21. A gesture-controlled user interface for inclusive design and evaluative study of its usability10.4236/jsea.2011.49059 ↗
22. Farhadi-Niaki, F., GhasemAghaei, R., and Arya, A. (2012, January 28–31). Empirical study of a vision-based depth-sensitive human-computer interaction system. Proceedings of the 10th Asia Pacific Conference on Computer Human Interaction, Matsue-city, Japan.10.1145/2350046.2350070 ↗
23. Farhadi-Niaki, F., Etemad, S.A., and Arya, A. (2013, January 21–26). Design and usability analysis of gesture-based control for common desktop tasks. Proceedings of the International Conference on Human-Computer Interaction, Las Vegas, NV, USA.10.1007/978-3-642-39330-3_23 ↗
24. Barclay, K., Wei, D., Lutteroth, C., and Sheehan, R. (December, January 28). A quantitative quality model for gesture-based user interfaces. Proceedings of the 23rd Australian Computer-Human Interaction Conference, Canberra, Australia.
25. Manresa-Yee, C., Amengual, E., and Ponsa, P. (2013, January 17–20). Usability of vision-based interfaces. Proceedings of the Actas del XIV Congreso Internacional Interacción Persona Ordenador, Madrid, Spain.
26. Cabral, M.C., Morimoto, C.H., and Zuffo, M.K. (2005, January 23–26). On the usability of gesture interfaces in virtual reality environments. Proceedings of the 2005 Latin American Conference on Human-Computer Interaction, Cuernavaca, Mexico.10.1145/1111360.1111370 ↗
27. Marin, G., Dominio, F., and Zanuttigh, P. (2014, January 27–30). Hand gesture recognition with leap motion and kinect devices. Proceedings of the IEEE International Conference on Image Processing (ICIP), Paris, France.10.1109/ICIP.2014.7025313 ↗
28. Potter, L.E., Araullo, J., and Carter, L. (2013, January 25–29). The leap motion controller: A view on sign language. Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration, Adelaide, Australia.10.1145/2541016.2541072 ↗
29. Analysis of the accuracy and robustness of the leap motion controller10.3390/s130506380 ↗
30. Thanyadit, S., and Pong, T. (2017, January 17–20). Desktop VR using a Mirror Metaphor for Natural User. Brighton, United Kingdom: ISS ’17. Proceedings of the Interactive Surfaces and Spaces, Brighton, UK.10.1145/3132272.3134131 ↗
31. Head-mounted display-based intuitive virtual reality training system for the mining industry10.1016/j.ijmst.2017.05.005 ↗
32. Jibin, Y., and Gao, Y. (2016, January 16–20). The design and research of 3D desktop interface based on the Pen+ Touch. Proceedings of the ICRA 2016-IEEE International Conference on Robotics and Automation, Stockholm, Sweden.
33. Song, P., Goh, W.B., Hutama, W., Fu, C.W., and Liu, X. (2012, January 5–10). A handlebar metaphor for virtual object manipulation with mid-air interaction. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Austin, TX, USA.10.1145/2207676.2208585 ↗
34. Cournia, N., Smith, J.D., and Duchowski, A.T. (2003, January 1–6). Gaze-vs. hand-based pointing in virtual environments. Proceedings of the CHI’03 Extended Abstracts on Human Factors in Computing Systems, Hague, The Netherlands.10.1145/765891.765982 ↗
35. User acceptance of computer technology: A comparison of two theoretical models10.1287/mnsc.35.8.982 ↗
36. Applying the technology acceptance model to vr with people who are favorable to its use
37. Dünser, A., Grasset, R., and Billinghurst, M. (2008). A Survey of Evaluation Techniques Used in Augmented Reality Studies, University of Canterbury.10.1145/1508044.1508049 ↗