Augmented Reality, Mixed Reality, and Hybrid Approach in Healthcare Simulation: A Systematic Review
Source abstract
Abstract
Simulation-based medical training is considered an effective tool to acquire/refine technical skills, mitigating the ethical issues of Halsted’s model. This review aims at evaluating the literature on medical simulation techniques based on augmented reality (AR), mixed reality (MR), and hybrid approaches. The research identified 23 articles that meet the inclusion criteria: 43% combine two approaches (MR and hybrid), 22% combine all three, 26% employ only the hybrid approach, and 9% apply only the MR approach. Among the studies reviewed, 22% use commercial simulators, whereas 78% describe custom-made simulators. Each simulator is classified according to its target clinical application: training of surgical tasks (e.g., specific tasks for training in neurosurgery, abdominal surgery, orthopedic surgery, dental surgery, otorhinolaryngological surgery, or also generic tasks such as palpation) and education in medicine (e.g., anatomy learning). Additionally, the review assesses the complexity, reusability, and realism of the physical replicas, as well as the portability of the simulators. Finally, we describe whether and how the simulators have been validated. The review highlights that most of the studies do not have a significant sample size and that they include only a feasibility assessment and preliminary validation; thus, further research is needed to validate existing simulators and to verify whether improvements in performance on a simulated scenario translate into improved performance on real patients.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Surgical Simulation and Training · Augmented Reality Applications · Anatomy and Medical Technology
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
EndoCAS Center, Department of Translational Research and of New Surgical and Medical Technologies, University of Pisa, 56124 Pisa, Italy
Dipartimento di Ingegneria dell’Informazione, University of Pisa, 56122 Pisa, Italy
Computer Science Department, Kettering University, Flint, MI 48504, USA
Department of Translational Research and of New Surgical and Medical Technologies, University of Pisa, 56126 Pisa, Italy
Center for Rehabilitative Medicine “Sport and Anatomy”, University of Pisa, 56121 Pisa, Italy
References (55)
Show source-provided references
1. The training of the surgeon: Dr. Halsted’s greatest legacy10.1177/000313489906501121 ↗
2. The changing face of surgical education: Simulation as the new paradigm10.1016/j.jss.2008.02.014 ↗
3. Simulation in surgery: A review10.1258/smj.2011.011098 ↗
4. Virtual reality: Surgical application--challenge for the new millennium10.1016/S1072-7515(01)00769-4 ↗
5. The impact of the 80-hour resident workweek on surgical residents and attending surgeons10.1097/01.sla.0000220042.48310.66 ↗
6. Surgical simulation: A systematic review10.1097/01.sla.0000200839.93965.26 ↗
7. The Southern Surgeons Club, Moore, M.J., and Bennett, C.L. (1995). The learning curve for laparoscopic cholecystectomy. Am. J. Surg., 170, 55–59.10.1016/S0002-9610(99)80252-9 ↗
8. Patient Safety, Competency, and the Future of Surgical Simulation10.1097/01.SIH.0000244453.20671.f2 ↗
9. Simulation in surgery: What’s needed next?10.1097/SLA.0000000000000826 ↗
10. See One, Do One, Teach One: Advanced Technology in Medical Education10.1197/j.aem.2004.08.003 ↗
11. The history of simulation in medical education and possible future directions10.1111/j.1365-2929.2006.02394.x ↗
12. The future vision of simulation in healthcare10.1097/01.SIH.0000258411.38212.32 ↗
13. Simulation-based learning: Just like the real thing10.4103/0974-2700.70743 ↗
14. Simulation-based medical education: An ethical imperative10.1097/00001888-200308000-00006 ↗
15. Patient safety and simulation-based medical education10.1080/01421590050110777 ↗
16. Progress in virtual reality simulators for surgical training and certification
17. Systematic review of randomized controlled trials on the effectiveness of virtual reality training for laparoscopic surgery10.1002/bjs.6344 ↗
18. Surgical Simulation Training Systems: Box Trainers, Virtual Reality and Augmented Reality Simulators
19. Innovations in surgery simulation: A review of past, current and future techniques10.21037/atm.2016.12.24 ↗
20. Surgical simulation: A current review10.1007/s00464-006-9072-0 ↗
21. Moher, D., Liberati, A., Tetzlaff, J., Altman, D.G., and The, P.G. (2009). Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med., 6.10.1371/journal.pmed.1000097 ↗
22. Augmented reality and physical hybrid model simulation for preoperative planning of metopic craniosynostosis surgery10.3171/2019.12.FOCUS19854 ↗
23. How to Build a Patient-Specific Hybrid Simulator for Orthopaedic Open Surgery: Benefits and Limits of Mixed-Reality Using the Microsoft HoloLens10.1155/2018/5435097 ↗
24. How to build patient-specific synthetic abdominal anatomies. An innovative approach from physical toward hybrid surgical simulators10.1002/rcs.390 ↗
25. Randomized controlled trial of virtual reality and hybrid simulation for robotic surgical training10.1111/j.1464-410X.2010.10060.x ↗
26. Augmented reality visualization of deformable tubular structures for surgical simulation10.1002/rcs.1681 ↗
27. Fuerst, D., Hollensteiner, M., and Schrempf, A. (2014, January 6–10). A novel augmented reality simulator for minimally invasive spine surgery. Proceedings of the 2014 Summer Simulation Multiconference, Monterey, CA, USA.
28. Mixed-reality simulation for orthognathic surgery10.1186/s40902-016-0059-z ↗
29. Halic, T., Kockara, S., Bayrak, C., and Rowe, R. (2010). Mixed reality simulation of rasping procedure in artificial cervical disc replacement (ACDR) surgery. BMC Bioinform., 11.10.1186/1471-2105-11-S6-S11 ↗
30. The use of augmented reality glasses in central line simulation: “see one, simulate many, do one competently, and teach everyone”10.2147/AMEP.S160704 ↗
31. Virtual reality based hybrid simulation for functional endoscopic sinus surgery10.1080/24725579.2019.1692263 ↗
32. Building a Simulated Medical Augmented Reality Training System10.1177/1541931214581244 ↗
33. A novel augmented reality simulator for skills assessment in minimal invasive surgery10.1007/s00464-014-3930-y ↗
34. Augmented reality intravenous injection simulator based 3D medical imaging for veterinary medicine10.1016/j.tvjl.2012.09.015 ↗
35. The Development of Optical See-through Display Based on Augmented Reality for Oral Implant Surgery Simulation10.3722/cadaps.2012.111-120 ↗
36. An integrated approach to endoscopic instrument tracking for augmented reality applications in surgical simulation training10.1002/rcs.1485 ↗
37. Laparoscopic skill improvement after virtual reality simulator training in medical students as assessed by augmented reality simulator10.1111/ases.12209 ↗
38. Onishi, K., Mizushino, K., Ikemoto, H., and Noborio, H. (2013, January 21–26). AR Dental Surgical Simulator Using Haptic Feedback. Proceedings of the International Conference on Human-Computer Interaction HCI 2013, Las Vegas, NV, USA.10.1007/978-3-642-39476-8_42 ↗
39. A mixed reality simulator for feline abdominal palpation training in veterinary medicine
40. Yonghang, T., Wei, L., Zhou, H., Peng, J., Li, Q., Li, F., Zhang, J., and Shi, J. (2019). Augmented-reality-driven medical simulation platform for percutaneous nephrolithotomy with cybersecurity awareness. Int. J. Distrib. Sens. Netw., 15.10.1177/1550147719840173 ↗
41. The Validity and Reliability of a Hybrid Reality Simulator for Wire Navigation in Orthopedic Surgery10.1109/THMS.2014.2339324 ↗
42. Tsujita, T., Sase, K., Chen, X., Tomita, M., Konno, A., Nakayama, M., Nakagawa, A., Abe, K., and Uchiyama, M. (2018, January 12–15). Development of a Surgical Simulator for Training Retraction of Tissue with an Encountered-Type Haptic Interface Using MR Fluid. Proceedings of the 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO 2018), Kuala Lumpur, Malaysia.10.1109/ROBIO.2018.8665269 ↗
43. Augmented reality fluoroscopy simulation of the guide-wire insertion in DHS surgery: A proof of concept study10.1016/j.medengphy.2018.02.007 ↗
44. Augmented Reality to Improve Surgical Simulation: Lessons Learned Towards the Design of a Hybrid Laparoscopic Simulator for Cholecystectomy10.1109/TBME.2018.2883816 ↗
45. Simulation-based acquisition of non-technical skills to improve patient safety10.1016/j.sempedsurg.2020.150906 ↗
46. The role of non-technical skills in surgery10.1016/j.amsu.2015.10.006 ↗
47. A Review of Simulators with Haptic Devices for Medical Training10.1007/s10916-016-0459-8 ↗
48. Turini, G., Condino, S., Parchi, P.D., Viglialoro, R.M., Piolanti, N., Gesi, M., Ferrari, M., and Ferrari, V. (2018, January 24–27). A Microsoft HoloLens Mixed Reality Surgical Simulator for Patient-Specific Hip Arthroplasty Training. Proceedings of the International Conference on Augmented Reality, Virtual Reality and Computer Graphics (AVR 2018), Otranto, Italy.10.1007/978-3-319-95282-6_15 ↗
49. Systematic Review of Patient-Specific Surgical Simulation: Toward Advancing Medical Education10.1016/j.jsurg.2017.05.018 ↗
50. Features and uses of high-fidelity medical simulations that lead to effective learning: A BEME systematic review10.1080/01421590500046924 ↗
51. Assessment in Medical Education
52. Simulation-based assessments in health professional education: A systematic review
53. Evaluation of Medical Simulations10.7205/MILMED-D-13-00255 ↗
54. A Systematic Review of Virtual Reality Simulators for Robot-assisted Surgery10.1016/j.eururo.2015.09.021 ↗
55. What is going on in augmented reality simulation in laparoscopic surgery?10.1007/s00464-008-0144-1 ↗