Review of Microsoft HoloLens Applications over the Past Five Years
Source abstract
Abstract
Since Microsoft HoloLens first appeared in 2016, HoloLens has been used in various industries, over the past five years. This study aims to review academic papers on the applications of HoloLens in several industries. A review was performed to summarize the results of 44 papers (dated between January 2016 and December 2020) and to outline the research trends of applying HoloLens to different industries. This study determined that HoloLens is employed in medical and surgical aids and systems, medical education and simulation, industrial engineering, architecture, civil engineering and other engineering fields. The findings of this study contribute towards classifying the current uses of HoloLens in various industries and identifying the types of visualization techniques and functions.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Augmented Reality Applications · Virtual Reality Applications and Impacts · 3D Surveying and Cultural Heritage
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Energy Resources Engineering, Pukyong National University, Busan 48513, Korea
Funding
National Research Foundation of Korea
References (72)
Show source-provided references
1. (2021, July 22). Demystifying the Virtual Reality Landscape. Available online: https://www.intel.com/content/www/us/en/tech-tips-and-tricks/virtual-reality-vs-augmented-reality.html.
2. Technical evaluation of HoloLens for multimedia: A first look10.1109/MMUL.2018.2873473 ↗
3. Effectiveness of the HoloLens mixed-reality headset in minimally invasive surgery: A simulation-based feasibility study10.1007/s00464-019-06862-3 ↗
4. Wang, W., Wu, X., Chen, G., and Chen, Z. (2018). Holo3DGIS: Leveraging Microsoft HoloLens in 3D Geographic Information. ISPRS Int. J. Geo-Inf., 7.10.3390/ijgi7020060 ↗
5. The future of augmented reality: Hololens-Microsoft’s AR headset shines despite rough edges [Resources_Tools and Toys]10.1109/MSPEC.2016.7473143 ↗
6. (2021, June 01). HoloLens Hardware Details. Available online: https://developer.microsoft.com/en-us/windows/mixed-reality/hololens_hardware_details.
7. Garon, M., Boulet, P.O., Doiron, J.P., Beaulieu, L., and Lalonde, J.F. (2016, January 19–23). Real-Time High Resolution 3D Data on the HoloLens. Proceedings of the 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), Merida, Mexico.10.1109/ISMAR-Adjunct.2016.0073 ↗
8. Augmenting the thermal flux experiment: A mixed reality approach with the HoloLens10.1119/1.4999739 ↗
9. Picallo, I., Vidal-Balea, A., Lopez-Iturri, P., Fraga-Lamas, P., Klaina, H., Fernández-Caramés, T.M., and Falcone, F. (2020). Wireless Channel Assessment of Auditoriums for the Deployment of Augmented Reality Systems for Enhanced Show Experience of Impaired Persons. Proceedings, 42.10.3390/ecsa-6-06587 ↗
10. Jing, H., Boxiong, Y., and Jiajie, C. (2017, January 21–22). Non-contact Measurement Method Research Based on HoloLens. Proceedings of the 2017 International Conference on Virtual Reality and Visualization (ICVRV), Zhengzhou, China.10.1109/ICVRV.2017.00061 ↗
11. Fernández-Caramés, T.M., Fraga-Lamas, P., Suárez-Albela, M., and Vilar-Montesinos, M. (2018). A Fog Computing and Cloudlet Based Augmented Reality System for the Industry 4.0 Shipyard. Sensors, 18.10.3390/s18061798 ↗
12. Vaquero-Melchor, D., and Bernardos, A.M. (2019). Enhancing Interaction with Augmented Reality through Mid-Air Haptic Feedback: Architecture Design and User Feedback. Appl. Sci., 9.10.3390/app9235123 ↗
13. Blanco-Novoa, Ó., Fraga-Lamas, P., Vilar-Montesinos, M.A., and Fernández-Caramés, T.M. (2020). Creating the Internet of Augmented Things: An Open-Source Framework to Make IoT Devices and Augmented and Mixed Reality Systems Talk to Each Other. Sensors, 20.10.3390/s20113328 ↗
14. Stark, E., Bisták, P., Kucera, E., Haffner, O., and Kozák, S. (2017, January 3–6). Virtual Laboratory Based on Node.js Technology and Visualized in Mixed Reality Using Microsoft HoloLens. Proceedings of the 2017 Federated Conference on Computer Science and Information Systems, Prague, Czech Republic.10.15439/2017F313 ↗
15. Osti, F., Santi, G.M., and Caligiana, G. (2019). Real Time Shadow Mapping for Augmented Reality Photorealistic Rendering. Appl. Sci., 9.10.3390/app9112225 ↗
16. Coolen, B., Beek, P.J., Geerse, D.J., and Roerdink, M. (2020). Avoiding 3D Obstacles in Mixed Reality: Does It Differ from Negotiating Real Obstacles?. Sensors, 20.10.3390/s20041095 ↗
17. Vaquero-Melchor, D., Bernardos, A.M., and Bergesio, L. (2020). SARA: A Microservice-Based Architecture for Cross-Platform Collaborative Augmented Reality. Appl. Sci., 10.10.3390/app10062074 ↗
18. An online calibration method for microsoft HoloLens10.1109/ACCESS.2019.2930701 ↗
19. Lee, J., Hafeez, J., Kim, K., Lee, S., and Kwon, S. (2019). A Novel Real-Time Match-Moving Method with HoloLens. Appl. Sci., 9.10.3390/app9142889 ↗
20. Voxel-Based Indoor Reconstruction from HoloLens Triangle Meshes10.5194/isprs-annals-V-4-2020-79-2020 ↗
21. Radkowski, R., and Kanunganti, S. (2018, January 18–22). Augmented reality system calibration for assembly support with the microsoft hololens. Proceedings of the International Manufacturing Science and Engineering Conference, College Station, TX, USA.10.1115/MSEC2018-6660 ↗
22. Interactive robot programing using mixed reality10.1016/j.ifacol.2018.11.517 ↗
23. Towards the Ultimate Mixed Reality Experience: HoloLens Display Architecture Choices10.1002/sdtp.11586 ↗
24. Riedlinger, U., Oppermann, L., and Prinz, W. (2019). Tango vs. HoloLens: A Comparison of Collaborative Indoor AR Visualisations Using Hand-Held and Hands-Free Devices. Multimodal Technol. Interact., 3.10.3390/mti3020023 ↗
25. Merino, L., Sotomayor-Gómez, B., Yu, X., Salgado, R., Bergel, A., Sedlmair, M., and Weiskopf, D. (2020, January 25–30). Toward Agile Situated Visualization: An Exploratory User Study. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.10.1145/3334480.3383017 ↗
26. Combining HoloLens and Leap-Motion for Free Hand-Based 3D Interaction in MR Environments10.1007/978-3-030-58465-8_24 ↗
27. Rokhsaritalemi, S., Sadeghi-Niaraki, A., and Choi, S.-M. (2020). A Review on Mixed Reality: Current Trends, Challenges and Prospects. Appl. Sci., 10.10.3390/app10020636 ↗
28. Chun, H.S. (2019). Application of Virtual Reality in the Medical Field, In Electronics and Telecommunications Trends, ETRI.
29. Augmented reality technology using Microsoft HoloLens in anatomic pathology10.5858/arpa.2017-0189-OA ↗
30. Chien, J.-C., Tsai, Y.-R., Wu, C.-T., and Lee, J.-D. (2019). HoloLens-Based AR System with a Robust Point Set Registration Algorithm. Sensors, 19.10.3390/s19163555 ↗
31. Use of mixed reality for surgery planning: Assessment and development workflow10.1016/j.yjbinx.2020.100077 ↗
32. Wu, M.-L., Chien, J.-C., Wu, C.-T., and Lee, J.-D. (2018). An Augmented Reality System Using Improved-Iterative Closest Point Algorithm for On-Patient Medical Image Visualization. Sensors, 18.10.3390/s18082505 ↗
33. An augmented reality system characterization of placement accuracy in neurosurgery10.1016/j.jocn.2019.12.014 ↗
34. Accuracy of Le Fort I osteotomy with combined computer-aided design/computer-aided manufacturing technology and mixed reality10.1016/j.ijom.2020.09.026 ↗
35. Mojica, C.M.M., Navkar, N.V., Tsekos, N.V., Tsagkaris, D., Webb, A., Birbilis, T., and Seimenis, I. (2017, January 23–25). Holographic Interface for three-dimensional visualization of MRI on HoloLens: A prototype platform for MRI guided neurosurgeries. Proceedings of the 2017 IEEE 17th International Conference on Bioinformatics and Bioengineering (BIBE), Washington, DC, USA.
36. Towards X-ray free endovascular interventions–using HoloLens for on-line holographic visualisation10.1049/htl.2017.0061 ↗
37. Through the HoloLens™ looking glass: Augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels10.1186/s41747-017-0033-2 ↗
38. HoloLens-Based Vascular Localization System: Precision Evaluation Study With a Three-Dimensional Printed Model10.2196/16852 ↗
39. Pedicle screw navigation using surface digitization on the Microsoft HoloLens10.1007/s11548-019-01973-7 ↗
40. Augmented reality navigation for spinal pedicle screw instrumentation using intraoperative 3D imaging10.1016/j.spinee.2019.10.012 ↗
41. Augmented reality improves procedural efficiency and reduces radiation dose for CT-guided lesion targeting: A phantom study using HoloLens 210.1038/s41598-020-75676-4 ↗
42. Gu, W., Shah, K., Knopf, J., Navab, N., and Unberath, M. (2020). Feasibility of image-based augmented reality guidance of total shoulder arthroplasty using microsoft HoloLens 1. Comput. Methods Biomech. Biomed. Eng. Imaging Vis., 1835556.10.1080/21681163.2020.1835556 ↗
43. Qian, L., Song, C., Jiang, Y., Luo, Q., Ma, X., Chiu, P.W., Li, Z., and Kazanzides, P. (2020, January 25–29). FlexiVision: Teleporting the Surgeon’s Eyes via Robotic Flexible Endoscope and Head-Mounted Display. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.10.1109/IROS45743.2020.9340716 ↗
44. Lee, E.-Y., Tran, V.T., and Kim, D. (2019). A Novel Head Mounted Display Based Methodology for Balance Evaluation and Rehabilitation. Sustainability, 11.10.3390/su11226453 ↗
45. Condino, S., Turini, G., Viglialoro, R., Gesi, M., and Ferrari, V. (2019). Wearable Augmented Reality Application for Shoulder Rehabilitation. Electronics, 8.10.3390/electronics8101178 ↗
46. Geerse, D.J., Coolen, B., and Roerdink, M. (2020). Quantifying Spatiotemporal Gait Parameters with HoloLens in Healthy Adults and People with Parkinson’s Disease: Test-Retest Reliability, Concurrent Validity, and Face Validity. Sensors, 20.10.3390/s20113216 ↗
47. Augmented reality in medical education and training
48. HoloLens and mobile augmented reality in medical and health science education: A randomised controlled trial10.1111/bjet.13049 ↗
49. Preliminary testing of an augmented reality headset as a DICOM viewer during autopsy10.1016/j.fri.2020.200417 ↗
50. How to build a patient-specific hybrid simulator for Orthopaedic open surgery: Benefits and limits of mixed-reality using the Microsoft HoloLens10.1155/2018/5435097 ↗
51. Caligiana, P., Liverani, A., Ceruti, A., Santi, G.M., Donnici, G., and Osti, F. (2020). An Interactive Real-Time Cutting Technique for 3D Models in Mixed Reality. Technologies, 8.10.3390/technologies8020023 ↗
52. Wang, S., Parsons, M., Stone-McLean, J., Rogers, P., Boyd, S., Hoover, K., Meruvia-Pastor, O., Gong, M., and Smith, A. (2017). Augmented Reality as a Telemedicine Platform for Remote Procedural Training. Sensors, 17.10.3390/s17102294 ↗
53. AR-based interaction for human-robot collaborative manufacturing10.1016/j.rcim.2019.101891 ↗
54. Gruenefeld, U., Prädel, L., Illing, J., Stratmann, T., Drolshagen, S., and Pfingsthorn, M. (2020, January 6–9). Mind the ARm: Realtime visualization of robot motion intent in head-mounted augmented reality. Proceedings of the Conference on Mensch und Computer, Magdeburg, Germany.10.1145/3404983.3405509 ↗
55. Smart retrofitting of machine tools in the context of industry 4.010.1016/j.procir.2020.05.064 ↗
56. Assessing augmented reality in production: Remote-assisted maintenance with HoloLens10.1016/j.procir.2020.05.025 ↗
57. Augmented reality visualization of production scheduling and monitoring10.1016/j.procir.2020.05.027 ↗
58. Szajna, A., Stryjski, R., Woźniak, W., Chamier-Gliszczyński, N., and Kostrzewski, M. (2020). Assessment of Augmented Reality in Manual Wiring Production Process with Use of Mobile AR Glasses. Sensors, 20.10.3390/s20174755 ↗
59. The effects of augmented reality on improving spatial problem solving for object assembly10.1016/j.aei.2018.10.004 ↗
60. Vidal-Balea, A., Blanco-Novoa, O., Fraga-Lamas, P., Vilar-Montesinos, M., and Fernández-Caramés, T.M. (2020). Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the Future. Appl. Sci., 10.10.3390/app10249073 ↗
61. Hübner, P., Clintworth, K., Liu, Q., Weinmann, M., and Wursthorn, S. (2020). Evaluation of HoloLens Tracking and Depth Sensing for Indoor Mapping Applications. Sensors, 20.10.3390/s20041021 ↗
62. Visualizing Toronto city data with Hololens: Using augmented reality for a city model10.1109/MCE.2018.2797658 ↗
63. Efficient use of mixed reality for bim system using microsoft HoloLens10.1016/j.ifacol.2019.12.762 ↗
64. Wu, M., Dai, S.-L., and Yang, C. (2020). Mixed Reality Enhanced User Interactive Path Planning for Omnidirectional Mobile Robot. Appl. Sci., 10.10.3390/app10031135 ↗
65. Autonomous vehicle control based on HoloLens technology and raspberry pi platform: An educational perspective10.1016/j.ifacol.2019.12.737 ↗
66. Hybrid SLAM modelling of autonomous robot with augmented reality device10.1016/j.matpr.2020.03.036 ↗
67. Marker-based localization of the microsoft hololens in building models
68. User experience of augmented reality system for astronaut’s manual work support10.3389/frobt.2018.00106 ↗
69. Xue, H., Sharma, P., and Wild, F. (2019). User Satisfaction in Augmented Reality-Based Training Using Microsoft HoloLens. Computers, 8.10.3390/computers8010009 ↗
70. Mehta, D., Siddiqui, M.F.H., and Javaid, A.Y. (2018). Facial Emotion Recognition: A Survey and Real-World User Experiences in Mixed Reality. Sensors, 18.10.3390/s18020416 ↗
71. Vidal-Balea, A., Blanco-Novoa, O., Picallo-Guembe, I., Celaya-Echarri, M., Fraga-Lamas, P., Lopez-Iturri, P., Azpilicueta, L., Falcone, F., and Fernández-Caramés, T.M. (2020). Analysis, Design and Practical Validation of an Augmented Reality Teaching System Based on Microsoft HoloLens 2 and Edge Computing. Eng. Proc., 2.10.3390/ecsa-7-08210 ↗
72. Walkable mixed reality map as interaction interface for virtual heritage