Toward Supporting Maxillo-Facial Surgical Guides Positioning with Mixed Reality—A Preliminary Study
Source abstract
Abstract
Following an oncological resection or trauma it may be necessary to reconstruct the normal anatomical and functional mandible structures to ensure the effective and complete social reintegration of patients. In most surgical procedures, reconstruction of the mandibular shape and its occlusal relationship is performed through the free fibula flap using a surgical guide which allows the surgeon to easily identify the location and orientation of the cutting plane. In the present work, we present a Mixed Reality (MR)-based solution to support professionals in surgical guide positioning. The proposed solution, through the use of a Head-Mounted Display (HMD) such as that of the HoloLens 2, visualizes a 3D virtual model of the surgical guide, positioned over the patient’s real fibula in the correct position as identified by the medical team before the procedure. The professional wearing the HMD is then assisted in positioning the real guide over the virtual one by our solution, which is capable of tracking the real guide during the whole process and computing its distance from the final position. The assessment results highlight that Mixed Reality is an eligible technology to support surgeons, combining the usability of the device with an improvement of the accuracy in fibula flap removal surgery.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Reconstructive Surgery and Microvascular Techniques · Surgical Simulation and Training · Anatomy and Medical Technology
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Politecnico di Torino, Corso Duca Abruzzi 24, 10129 Torino, Italy
Fondazione Piemonte per l’Oncologia, Strada Prov. 142, 10060 Candiolo, Italy
References (37)
Show source-provided references
1. Augmented reality and mixed reality for healthcare education beyond surgery: An integrative review10.5116/ijme.5e01.eb1a ↗
2. Multimodal mixed reality visualisation for intraoperative surgical guidance10.1007/s11548-020-02165-4 ↗
3. Innocente, C., Ulrich, L., Moos, S., and Vezzetti, E. (2022). Augmented Reality: Mapping Methods and Tools for Enhancing the Human Role in Healthcare HMI. Appl. Sci., 12.10.3390/app12094295 ↗
4. Mixed reality in oral and maxillofacial surgery: A symbiosis of virtual and augmented reality or a pointless technological gadget?
5. Virtual, augmented, and mixed reality applications in orthopedic surgery10.1002/rcs.2067 ↗
6. Mixed-reality hologram for diagnosis and surgical planning of double outlet of the right ventricle: A pilot study10.1016/j.crad.2020.10.017 ↗
7. Mixed Reality Intraoperative Navigation in Craniomaxillofacial Surgery10.1097/PRS.0000000000008375 ↗
8. Smart healthcare: Making medical care more intelligent10.1016/j.glohj.2019.07.001 ↗
9. Azimi, E., Winkler, A., Tucker, E., Qian, L., Doswell, J., Navab, N., and Kazanzides, P. (2018, January 18–21). Can mixed-reality improve the training of medical procedures?. Proceedings of the 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, HI, USA.10.1109/EMBC.2018.8513387 ↗
10. A review on the applications of virtual reality, augmented reality and mixed reality in surgical simulation: An extension to different kinds of surgery10.1080/17434440.2021.1860750 ↗
11. Clinical feasibility of a wearable mixed-reality device in neurosurgery10.1016/j.wneu.2018.06.208 ↗
12. Surgery guided by mixed reality: Presentation of a proof of concept10.1080/17453674.2018.1506974 ↗
13. Andersson, L., Kahnberg, K.E., and Pogrel, M.A. (2012). Oral and Maxillofacial Surgery, John Wiley & Sons.
14. Extended and unusual indications in jaw reconstruction with the fibula flap: An overview based on our 30-year experience10.1016/j.amsu.2020.12.049 ↗
15. Three-dimensional virtual surgery accuracy for free fibula mandibular reconstruction: Planned versus actual results10.1016/j.joms.2014.07.024 ↗
16. Universal surgical guide dedicated to mandibular reconstruction by fibula flap: A pilot multicentric feasibility study10.1016/j.ijom.2019.03.453 ↗
17. Positioning error of custom 3D-printed surgical guides for the radius: Influence of fitting location and guide design10.1007/s11548-017-1682-6 ↗
18. Clinical Factors Affecting the Accuracy of Guided Implant Surgery—A Systematic Review and Meta-analysis10.1016/j.jebdp.2017.07.007 ↗
19. Evaluation of virtual surgical planning systems and customized devices in fibula free flap mandibular reconstruction10.1007/s00405-019-05625-z ↗
20. A Comparative Study on a Novel Fibula Malleolus Cap to Increase the Accuracy of Oncologic Jaw Reconstruction10.3389/fonc.2021.743389 ↗
21. Douissard, J., Hagen, M.E., and Morel, P. (2019). The da Vinci surgical system. Bariatric Robotic Surgery, Springer.10.1007/978-3-030-17223-7_3 ↗
22. Ramirez, E.A., Helguero, C.G., Amaya, J.L., Mustahsan, V., Komatsu, D.E., Khan, F., and Kao, I. (2017, January 16–20). Improving positioning of 3D-printed surgical guides using image-processing techniques. Proceedings of the IEEE Second Ecuador Technical Chapters Meeting (ETCM), Salinas, Ecuador.10.1109/ETCM.2017.8247521 ↗
23. Robot-assisted endocrine surgery: Indications and drawbacks10.1089/lap.2018.0308 ↗
24. Maxillary reconstruction with the free fibula flap10.1097/01.PRS.0000160691.63029.74 ↗
25. Rokhsaritalemi, S., Sadeghi-Niaraki, A., and Choi, S.M. (2020). A review on mixed reality: Current trends, challenges and prospects. Appl. Sci., 10.10.3390/app10020636 ↗
26. A survey on augmented reality challenges and tracking
27. Effectiveness of the HoloLens mixed-reality headset in minimally invasive surgery: A simulation-based feasibility study10.1007/s00464-019-06862-3 ↗
28. Head-mounted display use in surgery: A systematic review10.1177/1553350619871787 ↗
29. Mixed reality applications in urology: Requirements and future potential10.1016/j.amsu.2021.102394 ↗
30. Augmented reality head-mounted display–based incision planning in cranial neurosurgery: A prospective pilot study10.3171/2021.5.FOCUS20735 ↗
31. Virtual reality for orthognathic surgery: The augmented reality environment concept10.1016/S0278-2391(97)90689-3 ↗
32. Application development with vuforia and unity 3D
33. Vassallo, R., Rankin, A., Chen, E.C., and Peters, T.M. (2017, January 11–16). Hologram stability evaluation for Microsoft HoloLens. Medical Imaging 2017: Image Perception, Observer Performance, and Technology Assessment. Proceedings of the International Society for Optics and Photonics, Orlando, FL, USA.10.1117/12.2255831 ↗
34. Ungureanu, D., Bogo, F., Galliani, S., Sama, P., Meekhof, C., Stühmer, J., Cashman, T.J., Tekin, B., Schönberger, J.L., and Olszta, P. (2020). Hololens 2 research mode as a tool for computer vision research. arXiv.
35. Analyzing and interpreting data from Likert-type scales10.4300/JGME-5-4-18 ↗
36. Efficient measurement of the user experience of interactive products. How to use the user experience questionnaire (UEQ). Example: Spanish language version
37. Construction of a Benchmark for the User Experience Questionnaire (UEQ)