Augmented and Virtual Reality Evolution and Future Tendency
Source abstract
Abstract
Augmented reality and virtual reality technologies are increasing in popularity. Augmented reality has thrived to date mainly on mobile applications, with games like Pokémon Go or the new Google Maps utility as some of its ambassadors. On the other hand, virtual reality has been popularized mainly thanks to the videogame industry and cheaper devices. However, what was initially a failure in the industrial field is resurfacing in recent years thanks to the technological improvements in devices and processing hardware. In this work, an in-depth study of the different fields in which augmented and virtual reality have been used has been carried out. This study focuses on conducting a thorough scoping review focused on these new technologies, where the evolution of each of them during the last years in the most important categories and in the countries most involved in these technologies will be analyzed. Finally, we will analyze the future trend of these technologies and the areas in which it is necessary to investigate to further integrate these technologies into society.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Augmented Reality Applications · Virtual Reality Applications and Impacts · IoT and Edge/Fog Computing
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Architecture and Computer Technology Department (Universidad de Sevilla), E.T.S Ingeniería Informática, Reina Mercedes Avenue, 41012 Seville, Spain
References (100+)
Show source-provided references
1. Exploring the evolution of mobile augmented reality for future entertainment systems10.1145/2582179.2633427 ↗
2. Paavilainen, J., Korhonen, H., Alha, K., Stenros, J., Koskinen, E., and Mayra, F. (2017, January 6–11). The Pokémon GO experience: A location-based augmented reality mobile game goes mainstream. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, USA.10.1145/3025453.3025871 ↗
3. Lv, Z., Halawani, A., Feng, S., Ur Réhman, S., and Li, H. (2015). Touch-less interactive augmented reality game on vision-based wearable device. Pers. Ubiquitous Comput.10.1007/s00779-015-0844-1 ↗
4. A taxonomy of mixed reality visual displays
5. Defining virtual reality: Dimensions determining telepresence10.1111/j.1460-2466.1992.tb00812.x ↗
6. Mobile Augmented Reality: the potential for education10.1016/j.sbspro.2013.10.385 ↗
7. Dynamic registration correction in video-based augmented reality systems10.1109/38.403828 ↗
8. New realities: A systematic literature review on virtual reality and augmented reality in tourism research10.1080/13683500.2017.1417359 ↗
9. Kimura, Y., Manabe, S., Ikeda, S., Kimura, A., and Shibata, F. (2019, January 23–27). Can Transparent Virtual Objects Be Represented Realistically on OST-HMDs?. Proceedings of the 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Osaka, Japan.10.1109/VR.2019.8798001 ↗
10. Virtual reality exposure therapy in anxiety disorders: A quantitative meta-analysis10.1002/da.20910 ↗
11. Virtual reality exposure therapy for anxiety disorders: A meta-analysis10.1016/j.janxdis.2007.04.006 ↗
12. (2019, December 26). Gartner’s Hype Cycle. Available online: https://www.gartner.com/en/research/methodologies/gartner-hype-cycle.
13. Lai, Z., Hu, Y.C., Cui, Y., Sun, L., Dai, N., and Lee, H.S. (2019). Furion: Engineering High-Quality Immersive Virtual Reality on Today’s Mobile Devices. IEEE Trans. Mob. Comput.10.1109/TMC.2019.2913364 ↗
14. Kruijff, E., Swan, J.E., and Feiner, S. (2010, January 13–16). Perceptual issues in augmented reality revisited. Proceedings of the 9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010, Seoul, Korea.10.1109/ISMAR.2010.5643530 ↗
15. Hagbi, N., Bergig, O., El-Sana, J., and Billinghurst, M. (2011). Shape recognition and pose estimation for mobile augmented reality. IEEE Trans. Vis. Comput. Gr.10.1109/TVCG.2010.241 ↗
16. Murphy-Chutorian, E., and Trivedi, M.M. (2010). Head pose estimation and augmented reality tracking: An integrated system and evaluation for monitoring driver awareness. IEEE Trans. Intell. Transp. Syst.10.1109/TITS.2010.2044241 ↗
17. Zhihan, L., Yin, T., Han, Y., Chen, Y., and Chen, G. (2011). WebVR-web virtual reality engine based on P2P network. J. Netw.
18. Nicolau, S., Soler, L., Mutter, D., and Marescaux, J. (2011). Augmented reality in laparoscopic surgical oncology. Surg. Oncol.10.1016/j.suronc.2011.07.002 ↗
19. Vankipuram, M., Kahol, K., McLaren, A., and Panchanathan, S. (2010). A virtual reality simulator for orthopedic basic skills: A design and validation study. J. Biomed. Inform.10.1016/j.jbi.2010.05.016 ↗
20. Baus, O., and Bouchard, S. (2014). Moving from virtual reality exposure-based therapy to augmented reality exposure-based therapy: A review. Front. Hum. Neurosci.10.3389/fnhum.2014.00112 ↗
21. Jack, D., Boian, R., Merians, A.S., Tremaine, M., Burdea, G.C., Adamovich, S.V., Recce, M., and Poizner, H. (2001). Virtual reality-enhanced stroke rehabilitation. IEEE Trans. Neural Syst. Rehabil. Eng.10.1109/7333.948460 ↗
22. Hondori, H.M., Khademi, M., Dodakian, L., Cramer, S.C., and Lopes, C.V. (2013). A spatial augmented reality rehab system for post-stroke hand rehabilitation. Stud. Health Technol. Inform.
23. Bujak, K.R., Radu, I., Catrambone, R., MacIntyre, B., Zheng, R., and Golubski, G. (2013). A psychological perspective on augmented reality in the mathematics classroom. Comput. Educ.10.1016/j.compedu.2013.02.017 ↗
24. Cai, S., Wang, X., and Chiang, F.K. (2014). A case study of Augmented Reality simulation system application in a chemistry course. Comput. Hum. Behav.10.1016/j.chb.2014.04.018 ↗
25. Bressler, D.M., and Bodzin, A.M. (2013). A mixed methods assessment of students’ flow experiences during a mobile augmented reality science game. J. Comput. Assist. Learn.10.1111/jcal.12008 ↗
26. Shelton, B.E., and Hedley, N.R. (2002, January 29–29). Using augmented reality for teaching Earth-Sun relationships to undergraduate geography students. Proceedings of the ART 2002—1st IEEE International Augmented Reality Toolkit Workshop, Darmstadt, Germany.
27. Monahan, T., McArdle, G., and Bertolotto, M. (2008). Virtual reality for collaborative e-learning. Comput. Educ.10.1016/j.compedu.2006.12.008 ↗
28. Galambos, P., Weidig, C., Baranyi, P., Aurich, J.C., Hamann, B., and Kreylos, O. (2012, January 2–5). VirCA NET: A case study for collaboration in shared virtual space. Proceedings of the 3rd IEEE International Conference on Cognitive Infocommunications, CogInfoCom 2012, Kosice, Slovakia.10.1109/CogInfoCom.2012.6421993 ↗
29. Wagner, D., and Barakonyi, I. (2003, January 10). Augmented reality kanji learning. Proceedings of the 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2003, Tokyo, Japan.
30. Gavish, N., Gutiérrez, T., Webel, S., Rodríguez, J., Peveri, M., Bockholt, U., and Tecchia, F. (2015). Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks. Interact. Learn. Environ.10.1080/10494820.2013.815221 ↗
31. Wang, J., Feng, Y., Zeng, C., and Li, S. (2014). An augmented reality based system for remote collaborative maintenance instruction of complex products. IEEE Int. Conf. Autom. Sci. Eng.10.1109/CoASE.2014.6899343 ↗
32. De Crescenzio, F., Fantini, M., Persiani, F., Di Stefano, L., Azzari, P., and Salti, S. (2011). Augmented reality for aircraft maintenance training and operations support. IEEE Comput. Gr. Appl.10.1109/MCG.2011.4 ↗
33. Wang, X., and Dunston, P.S. (2011). Comparative effectiveness of mixed reality-based virtual environments in collaborative design. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev.10.1109/TSMCC.2010.2093573 ↗
34. Back, M., Kimber, D., Rieffel, E., Dunnigan, A., Liew, B., Gattepally, S., Foote, J., Shingu, J., and Vaughan, J. (2010, January 19–23). The virtual chocolate factory: Building a real world mixed-reality system for industrial collaboration and control. Proceedings of the 2010 IEEE International Conference on Multimedia and Expo, ICME 2010, Suntec City, Singapore.10.1109/ICME.2010.5582532 ↗
35. Poppe, E., Brown, R., Johnson, D., and Recker, J. (September, January 28). A prototype augmented reality collaborative process modelling tool. Proceedings of the CEUR Workshop Proceedings, Clermont-Ferrand, France.
36. Matsas, E., and Vosniakos, G.C. (2017). Design of a virtual reality training system for human–robot collaboration in manufacturing tasks. Int. J. Interact. Des. Manuf.10.1007/s12008-015-0259-2 ↗
37. Qiao, X., Ren, P., Dustdar, S., Liu, L., Ma, H., and Chen, J. (2019). Web AR: A Promising Future for Mobile Augmented Reality-State of the Art, Challenges, and Insights. Proc. IEEE.10.1109/JPROC.2019.2895105 ↗
38. Huang, W., Alem, L., Tecchia, F., and Duh, H.B.L. (2018). Augmented 3D hands: a gesture-based mixed reality system for distributed collaboration. J. Multimodal User Interfaces.10.1007/s12193-017-0250-2 ↗
39. Sutcliffe, A.G., and Kaur, K.D. (2000). Evaluating the usability of virtual reality user interfaces. Behav. Inf. Technol.10.1080/014492900750052679 ↗
40. Comport, A.I., Marchand, É., and Chaumette, F. (2003, January 7–10). A real-time tracker for markerless augmented reality. Proceedings of the 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2003, Washington, DC, USA.
41. Wagner, D., Reitmayr, G., Mulloni, A., Drummond, T., and Schmalstieg, D. (2010). Real-time detection and tracking for augmented reality on mobile phones. IEEE Trans. Vis. Comput. Gr.10.1109/TVCG.2009.99 ↗
42. Bastug, E., Bennis, M., Medard, M., and Debbah, M. (2017). Toward Interconnected Virtual Reality: Opportunities, Challenges, and Enablers. IEEE Commun. Mag.10.1109/MCOM.2017.1601089 ↗
43. Dimensions of Mobile Augmented Reality for Learning: A First Inventory
44. Galambos, P., and Baranyi, P. (2011, January 3–7). VirCA as virtual intelligent space for RT-middleware. Proceedings of the IEEE/ASME International Conference on Advanced Intelligent Mechatronics, Budapest, Hungary.10.1109/AIM.2011.6027133 ↗
45. Papagiannakis, G., Singh, G., and Magnenat-Thalmann, N. (2008). A survey of mobile and wireless technologies for augmented reality systems. Comput. Anim. Virtual Worlds.10.1002/cav.221 ↗
46. Schmalstieg, D., Langlotz, T., and Billinghurst, M. (2011). Augmented reality 2.0. Virtual Realities: Dagstuhl Seminar 2008, Springer.10.1007/978-3-211-99178-7_2 ↗
47. Pose estimation for augmented reality: A hands-on survey10.1109/TVCG.2015.2513408 ↗
48. Mulloni, A., Seichter, H., and Schmalstieg, D. (September, January 30). Handheld augmented reality indoor navigation with activity-based instructions. Proceedings of the Mobile HCI 2011—13th International Conference on Human-Computer Interaction with Mobile Devices and Services, Stockholm, Sweden.10.1145/2037373.2037406 ↗
49. Olsson, T., Lagerstam, E., Kärkkäinen, T., and Väänänen-Vainio-Mattila, K. (2013). Expected user experience of mobile augmented reality services: A user study in the context of shopping centres. Pers. Ubiquitous Comput.10.1007/s00779-011-0494-x ↗
50. Gervautz, M., and Schmalstieg, D. (2012). Anywhere interfaces using handheld augmented reality. Computer.10.1109/MC.2012.72 ↗
51. Hürst, W., and Van Wezel, C. (2013). Gesture-based interaction via finger tracking for mobile augmented reality. Multimed. Tools Appl.10.1145/2502081.2502120 ↗
52. Clark, A., and Dünser, A. (2012, January 4–5). An interactive augmented reality coloring book. Proceedings of the 2012 IEEE Symposium on 3D User Interfaces (3DUI), Costa Mesa, CA, USA.10.1109/3DUI.2012.6184168 ↗
53. Vera, L., Gimeno, J., Coma, I., and Fernández, M. (2011). Augmented mirror: Interactive augmented reality system based on kinect. IFIP Conference on Human-Computer Interaction, Springer.10.1007/978-3-642-23768-3_63 ↗
54. Gugenheimer, J., Stemasov, E., Frommel, J., and Rukzio, E. (2017, January 6–11). Sharevr: Enabling co-located experiences for virtual reality between hmd and non-hmd users. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, USA.10.1145/3025453.3025683 ↗
55. Kantonen, T., Woodward, C., and Katz, N. (2010, January 20–24). Mixed reality in virtual world teleconferencing. Proceedings of the IEEE Virtual Reality, Waltham, MA, USA.10.1109/VR.2010.5444792 ↗
56. Benko, H., Jota, R., and Wilson, A.D. (2012, January 5–10). MirageTable: Freehand interaction on a projected augmented reality tabletop. Proceedings of the Conference on Human Factors in Computing Systems, Austin, TX, USA.10.1145/2207676.2207704 ↗
57. Maimone, A., and Fuchs, H. (2013, January 1–4). Computational augmented reality eyeglasses. Proceedings of the 2013 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2013, Adelaide, SA, Australia.10.1109/ISMAR.2013.6671761 ↗
58. Azmandian, M., Hancock, M., Benko, H., Ofek, E., and Wilson, A.D. (2016, January 7–12). Haptic retargeting: Dynamic repurposing of passive haptics for enhanced virtual reality experiences. Proceedings of the Conference on Human Factors in Computing Systems, San Jose, CA, USA.10.1145/2858036.2858226 ↗
59. Wu, D., Courtney, C.G., Lance, B.J., Narayanan, S.S., Dawson, M.E., Oie, K.S., and Parsons, T.D. (2010). Optimal arousal identification and classification for affective computing using physiological signals: Virtual reality stroop task. IEEE Trans. Affect. Comput.10.1109/T-AFFC.2010.12 ↗
60. Bau, O., and Poupyrev, I. (2012). REVEL: Tactile feedback technology for augmented reality. ACM Trans. Gr.10.1145/2343456.2343473 ↗
61. Linder, N., and Maes, P. (2010, January 3–6). LuminAR: Portable robotic augmented reality interface design and prototype. Proceedings of the UIST 2010—23rd ACM Symposium on User Interface Software and Technology, Adjunct Proceedings, New York, NY, USA.10.1145/1866218.1866237 ↗
62. Dunleavy, M. (2014). Design Principles for Augmented Reality Learning. TechTrends.10.1007/s11528-013-0717-2 ↗
63. Squire, K., and Klopfer, E. (2007). Augmented reality simulations on handheld computers. J. Learn. Sci.10.1080/10508400701413435 ↗
64. Lee, T., and Höllerer, T. (2007, January 11–13). Handy AR: Markerless inspection of augmented reality objects using fingertip tracking. Proceedings of the International Symposium on Wearable Computers, ISWC, Boston, MA, USA.10.1109/ISWC.2007.4373785 ↗
65. Bozgeyikli, E., Raij, A., Katkoori, S., and Dubey, R. (2016, January 16–19). Point & teleport locomotion technique for virtual reality. Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play, Austin, TX, USA.10.1145/2967934.2968105 ↗
66. Carmigniani, J., Furht, B., Anisetti, M., Ceravolo, P., Damiani, E., and Ivkovic, M. (2011). Augmented reality technologies, systems and applications. Multimed. Tools Appl.10.1007/s11042-010-0660-6 ↗
67. Security and privacy for augmented reality systems10.1145/2580723.2580730 ↗
68. Wilson, A.D., Benko, H., Izadi, S., and Hilliges, O. (2012, January 7–10). Steerable augmented reality with the Beamatron. Proceedings of the UIST’12—Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, Cambridge, MA, USA.10.1145/2380116.2380169 ↗
69. Hahn, J. (2012). Mobile augmented reality applications for library services. New Libr. World.10.1108/03074801211273902 ↗
70. Roth, D., Lugrin, J.L., Galakhov, D., Hofmann, A., Bente, G., Latoschik, M.E., and Fuhrmann, A. (2016, January 19–23). Avatar realism and social interaction quality in virtual reality. Proceedings of the 2016 IEEE Virtual Reality (VR), Greenville, SC, USA.10.1109/VR.2016.7504761 ↗
71. Kasahara, S., Heun, V., Lee, A.S., and Ishii, H. (December, January 28). Second surface: Multi-user spatial collaboration system based on augmented reality. Proceedings of the SIGGRAPH Asia 2012 Emerging Technologies, SA 2012, Singapore.10.1145/2407707.2407727 ↗
72. Pejsa, T., Kantor, J., Benko, H., Ofek, E., and Wilson, A. (March, January 27). Room2Room: Enabling Life-Size telepresence in a projected augmented reality environment. Proceedings of the ACM Conference on Computer Supported Cooperative Work CSCW, San Francisco, CA, USA.
73. Gelb, D., Subramanian, A., and Tan, K.H. (2011, January 7). Augmented reality for immersive remote collaboration. Proceedings of the 2011 IEEE Workshop on Person-Oriented Vision, POV 2011, Kona, HI, USA.10.1109/POV.2011.5712368 ↗
74. Slater, M., Spanlang, B., Sanchez-Vives, M.V., and Blanke, O. (2010). First person experience of body transfer in virtual reality. PLoS ONE.10.1371/journal.pone.0010564 ↗
75. Riva, G., Gaggioli, A., Grassi, A., Raspelli, S., Cipresso, P., Pallavicini, F., Vigna, C., Gagliati, A., Gasco, S., and Donvito, G. (2011). NeuroVR 2—A free virtual reality platform for the assessment and treatment in behavioral health care. Stud. Health Technol. Inform.
76. Larsen, C.R., Oestergaard, J., Ottesen, B.S., and Soerensen, J.L. (2012). The efficacy of virtual reality simulation training in laparoscopy: A systematic review of randomized trials. Acta Obstet. Gynecol. Scand.10.1111/j.1600-0412.2012.01482.x ↗
77. Virtual reality training for surgical trainees in laparoscopic surgery
78. Sielhorst, T., Feuerstein, M., and Navab, N. Advanced medical displays: A literature review of augmented reality. IEEE/OSA J. Disp. Technol.
79. Riva, G., Baños, R.M., Botella, C., Mantovani, F., and Gaggioli, A. Transforming experience: The potential of augmented reality and virtual reality for enhancing personal and clinical change. Front. Psychiatry, 2016.10.3389/fpsyt.2016.00164 ↗
80. Perrenot, C., Perez, M., Tran, N., Jehl, J.P., Felblinger, J., Bresler, L., and Hubert, J. (2012). The virtual reality simulator dV-Trainer® is a valid assessment tool for robotic surgical skills. Surg. Endosc.10.1007/s00464-012-2237-0 ↗
81. Yuan, Y., and Steed, A. Is the rubber hand illusion induced by immersive virtual reality? In Proceedings of the IEEE Virtual Reality, Waltham, MA, USA, 20–24 March 2010.10.1109/VR.2010.5444807 ↗
82. Moglia, A., Ferrari, V., Morelli, L., Ferrari, M., Mosca, F., and Cuschieri, A. (2016). A Systematic Review of Virtual Reality Simulators for Robot-assisted Surgery. Eur. Urol.10.1016/j.eururo.2015.09.021 ↗
83. Optale, G., Urgesi, C., Busato, V., Marin, S., Piron, L., Priftis, K., Gamberini, L., Capodieci, S., and Bordin, A. (2010). Controlling memory impairment in elderly adults using virtual reality memory training: A randomized controlled pilot study. Neurorehabil. Neural Repair.10.1177/1545968309353328 ↗
84. Hansen, C., Wieferich, J., Ritter, F., Rieder, C., and Peitgen, H.O. (2010). Illustrative visualization of 3D planning models for augmented reality in liver surgery. Int. J. Comput. Assist. Radiol. Surg.10.1007/s11548-009-0365-3 ↗
85. Botella, C., Bretón-López, J., Quero, S., Baños, R., and García-Palacios, A. (2010). Treating Cockroach Phobia with Augmented Reality. Behav. Ther.10.1016/j.beth.2009.07.002 ↗
86. Bernhardt, S., Nicolau, S.A., Soler, L., and Doignon, C. (2017). The status of augmented reality in laparoscopic surgery as of 2016. Med. Image Anal.10.1016/j.media.2017.01.007 ↗
87. Augmented reality in neurosurgery: A systematic review10.1007/s10143-016-0732-9 ↗
88. Virtual reality hypnosis: A case report10.1076/iceh.52.1.27.23925 ↗
89. Bohil, C.J., Alicea, B., and Biocca, F.A. (2011). Virtual reality in neuroscience research and therapy. Nat. Rev. Neurosci.10.1038/nrn3122 ↗
90. Virtual reality laparoscopic simulator for assessment in gynaecology10.1046/j.1471-0528.2003.02016.x ↗
91. Tarr, M.J., and Warren, W.H. (2002). Virtual reality in behavioral neuroscience and beyond. Nat. Neurosci.10.1038/nn948 ↗
92. Virtual reality–augmented rehabilitation for patients following stroke10.1093/ptj/82.9.898 ↗
93. Kandalaft, M.R., Didehbani, N., Krawczyk, D.C., Allen, T.T., and Chapman, S.B. (2013). Virtual reality social cognition training for young adults with high-functioning autism. J. Autism Dev. Disord.10.1007/s10803-012-1544-6 ↗
94. Reger, G.M., Holloway, K.M., Candy, C., Rothbaum, B.O., Difede, J.A., Rizzo, A.A., and Gahm, G.A. (2011). Effectiveness of virtual reality exposure therapy for active duty soldiers in a military mental health clinic. J. Trauma. Stress.10.1002/jts.20574 ↗
95. Rizzo, A., Parsons, T.D., Lange, B., Kenny, P., Buckwalter, J.G., Rothbaum, B., Difede, J.A., Frazier, J., Newman, B., and Williams, J. (2011). Virtual reality goes to war: A brief review of the future of military behavioral healthcare. J. Clin. Psychol. Med. Settings.10.1007/s10880-011-9247-2 ↗
96. Methamphetamine craving induced in an online virtual reality environment10.1016/j.pbb.2010.07.005 ↗
97. Khanal, P., Vankipuram, A., Ashby, A., Vankipuram, M., Gupta, A., Drumm-Gurnee, D., Josey, K., Tinker, L., and Smith, M. (2014). Collaborative virtual reality based advanced cardiac life support training simulator using virtual reality principles. J. Biomed. Inform.10.1016/j.jbi.2014.04.005 ↗
98. Su, L.M., Vagvolgyi, B.P., Agarwal, R., Reiley, C.E., Taylor, R.H., and Hager, G.D. (2009). Augmented Reality During Robot-assisted Laparoscopic Partial Nephrectomy: Toward Real-Time 3D-CT to Stereoscopic Video Registration. Urology.10.1016/j.urology.2008.11.040 ↗
99. Augmented reality in surgery10.1001/archsurg.139.2.170 ↗
100. Cecil, J., Ramanathan, P., Rahneshin, V., Prakash, A., and Pirela-Cruz, M. (2013, January 17–20). Collaborative virtual environments for orthopedic surgery. Proceedings of the 2013 IEEE International Conference on Automation Science and Engineering (CASE), Madison, WI, USA.10.1109/CoASE.2013.6654045 ↗