Extended Reality: Types and Applications
Source abstract
Abstract
This review is dedicated to the fast developing area of robotic technology cohesion with extended reality techniques. This paper analyzes existing extended reality technologies, categorizing them as virtual reality, augmented reality, and mixed reality. These technologies differ from each other based on resulting graphics and are similar in terms of hardware, software, and functional issues. The research methodology is shown in a separate section, which declares the depth of the research, used keywords, and criteria for paper selection. A brief classification of extended realty issues provides a systematic approach to these techniques and reveals their applications in robotics, placing the focus on mobile robotic technology. The term extended reality covers technologies of virtual, augmented, and mixed reality, which are classified in this review. Each section of the reviewed field gives an original issue classification in a table format. Finally, the general outcome of the review is summarized in the discussion, and conclusions are drawn.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Architecture and Computational Design
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Mechanics, Vilnius Gediminas Technical University, Plytinės 25, LT10505 Vilnius, Lithuania
Funding
European Commission
References (100+)
Show source-provided references
1. Gupta, P., Bhadani, K., Bandyopadhyay, A., Banik, D., and Swain, S. (2023, January 9–11). Impact of Metaverse in the Near “Future”. Proceedings of the 4th International Conference on Intelligent Engineering and Management, (ICIEM), London, UK.10.1109/ICIEM59379.2023.10166025 ↗
2. A Systematic Review of Google Cardboard Used in Education
3. Xue, C., Qiao, Y., and Murray, N. (September, January 31). Enabling Human-Robot-Interaction for Remote Robotic Operation via Augmented Reality. Proceedings of the 21st IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks, WoWMoM 2020, Cork, Ireland.10.1109/WoWMoM49955.2020.00046 ↗
4. (2025, March 05). Path Planning. MATLAB & Simulink. Available online: https://se.mathworks.com/discovery/path-planning.html.
5. Intuitive Robot Teleoperation through Multi-Sensor Informed Mixed Reality Visual Aids10.1109/ACCESS.2021.3057808 ↗
6. Batistute, A., Santos, E., Takieddine, K., Lazari, P.M., Da Rocha, L.G., and Vivaldini, K.C.T. (2021, January 11–15). Extended Reality for Teleoperated Mobile Robots. Proceedings of the 2021 Latin American Robotics Symposium, 2021 Brazilian Symposium on Robotics, and 2021 Workshop on Robotics in Education, LARS-SBR-WRE, Natal, Brazil.10.1109/LARS/SBR/WRE54079.2021.9605474 ↗
7. Extended Reality Applications in Industry 4.0.—A Systematic Literature Review10.1016/j.tele.2022.101863 ↗
8. Walker, M.E., Gramopadhye, M., Ikeda, B., Burns, J., and Szafr, D. (2024, January 11–14). The Cyber-Physical Control Room: A Mixed Reality Interface for Mobile Robot Teleoperation and Human-Robot Teaming. Proceedings of the ACM/IEEE International Conference on Human-Robot Interaction, Boulder, CO, USA.10.1145/3610977.3634981 ↗
9. Illing, B., Westhoven, M., Gaspers, B., Smets, N., Bruggemann, B., and Mathew, T. (September, January 31). Evaluation of Immersive Teleoperation Systems Using Standardized Tasks and Measurements. Proceedings of the 29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020, Naples, Italy.10.1109/RO-MAN47096.2020.9223497 ↗
10. Remote Teaching System for Robotic Surgery and Its Validation: Results of a Randomized Controlled Study10.1007/s00464-023-10443-w ↗
11. Devic, A., Vidakovic, J., and Zivkovic, N. (2024). Development of Standalone Extended-Reality-Supported Interactive Industrial Robot Programming System. Machines, 12.10.3390/machines12070480 ↗
12. Critical Design and Control Issues of Indoor Autonomous Mobile Robots: A Review10.1109/ACCESS.2021.3062557 ↗
13. (2024, November 27). VR, AR, MR, and XR: The Metaverse Market and XR-Related Technologies. Available online: https://techtimes.dexerials.jp/en/elemental-technologies/applied-technology-for-xr/.
14. Digital Twin- and Extended Reality-Based Telepresence for Collaborative Robot Programming in the 6G Perspective10.1016/j.dcan.2022.10.007 ↗
15. Arena, F., Collotta, M., Pau, G., and Termine, F. (2022). An Overview of Augmented Reality. Computers, 11.10.3390/computers11020028 ↗
16. Jung, K., Nguyen, V.T., and Lee, J. (2021). BlocklyXR: An Interactive Extended Reality Toolkit for Digital Storytelling. Appl. Sci., 11.10.3390/app11031073 ↗
17. Comunicazione Digitale XR: Assessing the Impact of Extended Reality Technologies on Learning
18. Vergara, D., Extremera, J., Rubio, M.P., and Dávila, L.P. (2019). Meaningful Learning Through Virtual Reality Learning Environments: A Case Study in Materials Engineering. Appl. Sci., 9.10.3390/app9214625 ↗
19. Tan, Y., Xu, W., Li, S., and Chen, K. (2022). Augmented and Virtual Reality (AR/VR) for Education and Training in the AEC Industry: A Systematic Review of Research and Applications. Buildings, 12.10.3390/buildings12101529 ↗
20. Virtual Reality for Safety Training: A Systematic Literature Review and Meta-Analysis10.1016/j.ssci.2023.106372 ↗
21. Theoretical Foundations and Implications of Augmented Reality, Virtual Reality, and Mixed Reality for Immersive Learning in Health Professions Education10.1186/s41077-024-00311-5 ↗
22. Einloft, J., Meyer, H.L., Bedenbender, S., Morgenschweis, M.L., Ganser, A., Russ, P., Hirsch, M.C., and Grgic, I. (2024). Immersive Medical Training: A Comprehensive Longitudinal Study of Extended Reality in Emergency Scenarios for Large Student Groups. BMC Med. Educ., 24.10.1186/s12909-024-05957-3 ↗
23. Mixed Reality in the Operating Room: A Systematic Review10.1007/s10916-024-02095-7 ↗
24. Sasu, V.G., Cîrneci, D., Goga, N., Popa, R., Neacșu, R.F., Goga, M., Podina, I., Bratosin, I.A., Bordea, C.A., and Pomana, L.N. (2024). Enhancing Multisensory Virtual Reality Environments through Olfactory Stimuli for Autobiographical Memory Retrieval. Appl. Sci., 14.10.20944/preprints202407.1001.v1 ↗
25. Bioinspired Head-To-Shoulder Reference Frame Transformation for Movement-Based Arm Prosthesis Control10.1109/LRA.2024.3433751 ↗
26. BIM-VR Framework for Building Information Modelling in Engineering Education10.3991/ijim.v14i06.13397 ↗
27. Virtual Reality in Design Processes-a Literature Review of Benefits, Challenges, and Potentials10.7577/formakademisk.3874 ↗
28. Ahmed, K.G. (April, January 4). Integrating VR-Enabled BIM in Building Design Studios, Architectural Engineering Program, UAEU: A Pilot Study. Proceedings of the 2020 Advances in Science and Engineering Technology International Conferences, ASET 2020, Dubai, United Arab Emirates.10.1109/ASET48392.2020.9118308 ↗
29. A Design Review Session Protocol for the Implementation of Immersive Virtual Reality in Usability-Focused Analysis
30. (2024, December 01). Google Maps Information. Available online: https://www.google.com/streetview/.
31. Exploring the Critical Success Factors of Virtual Reality Adoption in the Hotel Industry10.1108/IJCHM-09-2023-1510 ↗
32. (2024, November 26). Louvre Virtual Tours Information. Available online: https://www.louvre.fr/en/online-tours.
33. Sylaiou, S., Kasapakis, V., Dzardanova, E., and Gavalas, D. (2018, January 25–27). Leveraging Mixed Reality Technologies to Enhance Museum Visitor Experiences. Proceedings of the 9th International Conference on Intelligent Systems 2018: Theory, Research and Innovation in Applications, IS 2018, Funchal, Portugal.10.1109/IS.2018.8710530 ↗
34. A Review on Tracking Head Movement in Augmented Reality Systems10.1016/j.procs.2023.10.431 ↗
35. (2024, December 01). Half-Life: Alyx Information on Steam. Available online: https://store.steampowered.com/app/546560/HalfLife_Alyx/.
36. The Effect of Auditory-Motor Synchronization in Exergames on the Example of the VR Rhythm Game BeatSaber10.1145/3549516 ↗
37. Alonso, F., Faus, M., Riera, J.V., Fernandez-Marin, M., and Useche, S.A. (2023). Effectiveness of Driving Simulators for Drivers’ Training: A Systematic Review. Appl. Sci., 13.10.3390/app13095266 ↗
38. Integrating Extended Reality and Robotics in Construction: A Critical Review10.1016/j.aei.2024.102795 ↗
39. Head-Mounted Display Augmented Reality in Manufacturing: A Systematic Review10.1016/j.rcim.2023.102567 ↗
40. Chen, J., Sun, B., Pollefeys, M., and Blum, H. (2024, January 13–17). A 3D Mixed Reality Interface for Human-Robot Teaming. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan.10.1109/ICRA57147.2024.10611017 ↗
41. Healthcare Robots to Combat COVID-1910.1007/978-981-15-9682-7_10 ↗
42. Extended Reality Training for Mass Casualty Incidents: A Systematic Review on Effectiveness and Experience of Medical First Responders10.1186/s12245-024-00685-3 ↗
43. Elicitation Study Investigating Hand and Foot Gesture Interaction for Immersive Maps in Augmented Reality10.1080/15230406.2019.1696232 ↗
44. Ntagiantas, A., Konstantakis, M., Aliprantis, J., Manousos, D., Koumakis, L., and Caridakis, G. (2022). An Augmented Reality Children’s Book Edutainment through Participatory Content Creation and Promotion Based on the Pastoral Life of Psiloritis. Appl. Sci., 12.10.3390/app12031339 ↗
45. Liao, S.C., Shao, S.C., Gao, S.Y., and Lai, E.C.C. (2024). Augmented Reality Visualization for Ultrasound-Guided Interventions: A Pilot Randomized Crossover Trial to Assess Trainee Performance and Cognitive Load. BMC Med. Educ., 24.10.1186/s12909-024-05998-8 ↗
46. Makhataeva, Z., and Varol, H.A. (2020). Augmented Reality for Robotics: A Review. Robotics, 9.10.3390/robotics9020021 ↗
47. Current Practises and the Future of Robotic Surgical Training10.1016/j.surge.2023.02.006 ↗
48. Zea, A., Fennel, M., and Hanebeck, U.D. (2022, January 4–7). Robot Joint Tracking With Mobile Depth Cameras for Augmented Reality Applications. Proceedings of the 2022 25th International Conference on Information Fusion, FUSION, Linköping, Sweden.10.23919/FUSION49751.2022.9841341 ↗
49. Konstantinidis, F.K., Kansizoglou, I., Santavas, N., Mouroutsos, S.G., and Gasteratos, A. (2020). MARMA: A Mobile Augmented Reality Maintenance Assistant for Fast-Track Repair Procedures in the Context of Industry 4.0. Machines, 8.10.3390/machines8040088 ↗
50. Xue, Z., Yang, J., Chen, R., He, Q., Li, Q., and Mei, X. (2024). AR-Assisted Guidance for Assembly and Maintenance of Avionics Equipment. Appl. Sci., 14.10.3390/app14031137 ↗
51. Human Factors While Using Head-Up-Display in Low Visibility Flying Conditions10.32604/iasc.2023.034203 ↗
52. Zhou, C., Qiao, W., Hua, J., and Chen, L. (2024). Automotive Augmented Reality Head-Up Displays. Micromachines, 15.10.3390/mi15040442 ↗
53. Gao, F., Ge, X., Li, J., Fan, Y., Li, Y., and Zhao, R. (2024). Intelligent Cockpits for Connected Vehicles: Taxonomy, Architecture, Interaction Technologies, and Future Directions. Sensors, 24.10.3390/s24165172 ↗
54. Augmented Reality for Construction Site Monitoring and Documentation10.1109/JPROC.2013.2294314 ↗
55. Mobile Projective Augmented Reality for Collaborative Robots in Construction10.1016/j.autcon.2021.103704 ↗
56. Integrating Augmented Reality in Architectural Design: A New Paradigm10.1051/e3sconf/202450503009 ↗
57. Review on SLAM Algorithms for Augmented Reality10.1016/j.displa.2024.102806 ↗
58. Tracking and Co-Location of Global Point Clouds for Large-Area Indoor Environments10.1007/s10055-024-01004-0 ↗
59. A New XR-Based Human-robot Collaboration Assembly System Based on Industrial Metaverse10.1016/j.jmsy.2024.05.001 ↗
60. Calandra, D., Prattico, F.G., Fiorenza, J., and Lamberti, F. (2023, January 6–8). Exploring the Suitability of a Digital Twin- and EXtended Reality-Based Telepresence Platform for a Collaborative Robotics Training Scenario over next-Generation Mobile Networks. Proceedings of the EUROCON 2023—20th International Conference on Smart Technologies, Torino, Italy.10.1109/EUROCON56442.2023.10198883 ↗
61. Weistroffer, V., Keith, F., Bisiaux, A., Andriot, C., and Lasnier, A. (2022). Using Physics-Based Digital Twins and Extended Reality for the Safety and Ergonomics Evaluation of Cobotic Workstations. Front. Virtual Real., 3.10.3389/frvir.2022.781830 ↗
62. Planning and Control of Autonomous Mobile Robots for Intralogistics: Literature Review and Research Agenda10.1016/j.ejor.2021.01.019 ↗
63. Kumar, A.A., Uz Zaman, U.K., and Plapper, P. (2023). Collaborative Robots. Handbook of Manufacturing Systems and Design: An Industry 4.0 Perspective, CRC Press.10.1201/9781003327523-8 ↗
64. Review on Existing VR/AR Solutions in Human–Robot Collaboration10.1016/j.procir.2020.05.259 ↗
65. Dynamic Pose Tracking Accuracy Improvement via Fusing HTC Vive Trackers and Inertia Measurement Units10.1007/s12541-023-00891-8 ↗
66. Jansen, M., Donkervliet, J., Trivedi, A., and Iosup, A. (2023, January 15–19). Can My WiFi Handle the Metaverse? A Performance Evaluation Of Meta’s Flagship Virtual Reality Hardware. Proceedings of the ICPE 2023—Companion of the 2023 ACM/SPEC International Conference on Performance Engineering, Coimbra, Portugal.10.1145/3578245.3585022 ↗
67. The Metaverse and Beyond: Implementing Advanced Multiverse Realms With Smart Wearables10.1109/ACCESS.2022.3215736 ↗
68. (2024, October 14). Meta Quest 3: Mixed Reality VR Specifications. Available online: https://www.meta.com/quest/quest-3/.
69. (2024, October 14). HTC VIVE XR Headsets Information. Available online: https://www.vive.com/us/product/.
70. (2024, October 14). Microsoft HoloLens Information. Available online: https://www.microsoft.com/en-us/hololens.
71. (2025, March 06). HoloLens 2 Hardware. Microsoft Learn. Available online: https://learn.microsoft.com/en-us/hololens/hololens2-hardware#device-specifications.
72. (2024, October 14). Samsung Gear Vr Specifications. Available online: https://www.samsung.com/us/support/mobile/virtual-reality/gear-vr/gear-vr-with-controller-galaxy-note8-edition/.
73. Jia, G., Li, X., Zhang, D., Xu, W., Lv, H., Shi, Y., and Cai, M. (2022). Visual-SLAM Classical Framework and Key Techniques: A Review. Sensors, 22.10.3390/s22124582 ↗
74. Visual SLAM Algorithms and Their Application for AR, Mapping, Localization and Wayfinding10.1016/j.array.2022.100222 ↗
75. Serious Games in Digital Gaming: A Comprehensive Review of Applications, Game Engines and Advancements10.37394/232018.2023.11.2 ↗
76. Some Aspects of the Development of Low-Cost Augmented Reality Learning Environments as Examples for Future Interfaces in Technology Enhanced Learning
77. (2024, November 22). ArtoolkitX Information. Available online: https://github.com/artoolkitx/artoolkitx.
78. Pant, M., Agarwal, R., and Sharma, H.P. (2021, January 3–4). Augmented Reality Android App To Shoot Prefab on Scanned Surface. Proceedings of the 2021 9th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO), Noida, India.10.1109/ICRITO51393.2021.9596394 ↗
79. (2024, November 22). Overview of ARCore. Available online: https://developers.google.com/ar/develop.
80. (2024, November 22). Apple RealityKit Documentation. Available online: https://developer.apple.com/documentation/realitykit.
81. Permozer, I., and Orehovacki, T. (2019, January 20–24). Utilizing Apple’s ARKIT 2.0 for Augmented Reality Application Development. Proceedings of the 2019 42nd International Convention on Information and Communication Technology, Electronics and Microelectronics, MIPRO, Opatija, Croatia.10.23919/MIPRO.2019.8756928 ↗
82. (2024, November 22). Vuforia Engine Overview. Available online: https://developer.vuforia.com/library/getting-started/vuforia-features.
83. (2024, November 22). Unity—Manual: XR. Available online: https://docs.unity3d.com/Manual/XR.html.
84. Singh, S., and Kaur, A. (2022, January 18–19). Game Development Using Unity Game Engine. Proceedings of the ICAN 2022—3rd International Conference on Computing, Analytics and Networks, Rajpura, Punjab, India.10.1109/ICAN56228.2022.10007155 ↗
85. (2024, November 22). XR in Unreal Engine 5.5 Documentation. Available online: https://dev.epicgames.com/documentation/en-us/unreal-engine/developing-for-xr-experiences-in-unreal-engine.
86. Remenyi, A., Alsaleh, S., and Tepljakov, A. (2024, January 26–28). Assessing Interaction Mechanics in Extended Reality for Control Engineering Applications. Proceedings of the 2024 32nd International Conference on Software, Telecommunications and Computer Networks, SoftCOM, Split, Croatia.10.23919/SoftCOM62040.2024.10721783 ↗
87. (2024, November 22). Mixed Reality Documentation. Available online: https://learn.microsoft.com/en-us/windows/mixed-reality/?view=mrtkunity-2022-05.
88. Ivanova, B., Hristov, G., Shoylekova, K., Rusev, R., and Vassilev, T. (2024, January 20–24). Improving Museum Experience Using the Durostorum Application for the Digital Restoration of Artifacts. Proceedings of the 2024 47th ICT and Electronics Convention, MIPRO, Opatija, Croatia.10.1109/MIPRO60963.2024.10569760 ↗
89. (2024, November 22). MLSDK Information. Available online: https://developer-docs.magicleap.cloud/docs/guides/getting-started/developer-environment/.
90. VOIR: Virtual Reality Visualization Software for Large-Scale Simulations10.1585/pfr.19.1401024 ↗
91. (2024, November 22). OpenXR Information. Available online: https://www.khronos.org/openxr/.
92. (2024, November 22). Rviz, ROS Visualization Software Information. Available online: https://wiki.ros.org/rviz.
93. Gharaybeh, Z., Chizeck, H., and Stewart, A. (2019, January 27–31). Telerobotic Control in Virtual Reality. Proceedings of the OCEANS 2019 MTS/IEEE Seattle, OCEANS, Seattle, WA, USA.10.23919/OCEANS40490.2019.8962616 ↗
94. Xiao, C., and Lifeng, Z. (2014, January 27–29). Implementation of Mobile Augmented Reality Based on Vuforia and Rawajali. Proceedings of the IEEE International Conference on Software Engineering and Service Sciences, ICSESS, Beijing, China.10.1109/ICSESS.2014.6933713 ↗
95. Andrade, R., and Shool, S. (2020, January 17). Pixeldust Studios Reptopia Magic Leap Experience. Proceedings of the ACM SIGGRAPH 2020 Immersive Pavilion, SIGGRAPH 2020, Virtual.10.1145/3388536.3407892 ↗
96. Quest 3 Immersive Display with High PPI and Hybrid Backplane Technology10.1002/sdtp.17772 ↗
97. Chen, W., Cao, Y., Qin, Y., Chen, E., Zhou, G., and Li, W. (2023, January 26–29). Real-Time Super-Resolution: A New Mechanism for XR over 5G-Advanced. Proceedings of the IEEE Wireless Communications and Networking Conference, WCNC, Glasgow, UK.10.1109/WCNC55385.2023.10118858 ↗
98. Kapse, K. (2021, January 19–20). An Overview of Current Deep Learned Rendering Technologies. Proceedings of the 2021 7th International Conference on Advanced Computing and Communication Systems, ICACCS, Coimbatore, India.10.1109/ICACCS51430.2021.9441822 ↗
99. GFFE: G-Buffer Free Frame Extrapolation for Low-Latency Real-Time Rendering
100. (2025, February 14). Reflex 2 Technology. NVIDIA. Available online: https://www.nvidia.com/en-eu/geforce/technologies/reflex/.