journal article·2024-12-31Open access

A Novel Virtual Reality-Based Simulator for Maxillofacial Reconstruction Surgery: Development and Validation Study

Jun-Seong Kim, Kun-Woo Kim, Hyo-Joon Kim, Seong-Yong Moon

Applied Sciences· Volume 15· Issue 1

Abstract

Maxillofacial reconstruction surgery involves restoring bones or skeletal structures in areas such as the mouth, jaw, and face using bones like the iliac crest and fibula. This surgery requires a high level of difficulty and precision, necessitating extensive practice and accurate 3D model simulations. However, due to limitations in training environments, opportunities for sufficient practice are restricted, and the precision of simulations may be compromised by the limitations of existing tools. To address these challenges, this paper proposes a maxillofacial reconstruction surgery simulator utilizing virtual reality technology. The proposed method allows users to explore a virtual space through a head-mounted display, where they can visualize, navigate, and manipulate bone models (move and rotate) using the joystick and buttons of a controller, as well as perform resection operations. Additionally, to verify the effectiveness of the simulator, performance evaluation is conducted through frame per second and resource usage analysis, usability testing is performed via questionnaires with dental students, and accuracy validation is carried out for the reconstruction models. The results of each evaluation method are analyzed to confirm the utility and potential of the proposed simulator.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Facial Trauma and Fracture Management · Surgical Simulation and Training · Anatomy and Medical Technology

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Clinical Coordinating Center, College of Dentistry, Chosun University, Gwangju 61452, Republic of Korea

Dental Biomedical Engineering, College of Dentistry, Chosun University, Gwangju 61452, Republic of Korea

Department of Oral and Maxillofacial Surgery, Chosun University Dental Hospital, Gwangju 61452, Republic of Korea

Funding

National Research Foundation of Korea (NRF) · Ministry of Education

References (53)

Show source-provided references
1. Strategies for Effective Teaching in Clinical Clerkship10.7599/hmr.2012.32.1.51 ↗
2. Importance of clinical medicine in medical education: Review of the articles in this issue10.3946/kjme.2015.27.4.243 ↗
3. Virtual or augmented reality to enhance surgical education and surgical planning10.1016/j.thorsurg.2019.03.010 ↗
4. Virtual reality head-mounted displays in medical education: A systematic review10.1097/SIH.0000000000000636 ↗
5. Barcali, E., Iadanza, E., Manetti, L., Francia, P., Nardi, C., and Bocchi, L. (2022). Augmented reality in surgery: A scoping review. Appl. Sci., 12.10.3390/app12146890 ↗
6. The impact of extended reality on surgery: A scoping review10.1007/s00264-022-05663-z ↗
7. How effective is a clerkship as a learning environment?10.1080/01421590127200 ↗
8. Program development of student internship (subinternship) in Gachon medical school10.3946/kjme.2003.15.2.113 ↗
9. Application of virtual reality technology in clinical medicine
10. Virtual and augmented reality put a twist on medical education10.1001/jama.2017.20800 ↗
11. Virtual reality and the transformation of medical education10.7861/fhj.2019-0036 ↗
12. (2024, November 01). Oxford Medical Simulation. Available online: https://oxfordmedicalsimulation.com.
13. Falah, J., Khan, S., Alfalah, T., Alfalah, S.F.M., Chan, W., Harrison, D.K., and Charissis, V. (2014, January 27–29). Virtual Reality medical training system for anatomy education. Proceedings of the 2014 Science and Information Conference, London, UK.10.1109/SAI.2014.6918271 ↗
14. Schild, J., Misztal, S., Roth, B., Flock, L., Luiz, T., Lerner, D., Herkersdorf, M., Weaner, K., Neuberaer, M., and Franke, A. (2018, January 18–22). Ap-plying multi-user virtual reality to collaborative medical training. Proceedings of the 2018 IEEE Conference on Virtual Real-ity and 3D User Interfaces (VR), Tuebingen/Reutlingen, Germany.10.1109/VR.2018.8446160 ↗
15. Ayoub, A., and Pulijala, Y. (2019). The application of virtual reality and augmented reality in Oral & Maxillofacial Surgery. BMC Oral Health, 19.10.1186/s12903-019-0937-8 ↗
16. (2024, November 01). Ultraleap. Available online: https://www.ultraleap.com.
17. Virtual Reality Training in Unicompartmental Knee Arthroplasty: A Randomized, Blinded Trial10.1016/j.jsurg.2022.06.008 ↗
18. Immersive Virtual Reality in Basic Point-of-Care Ultrasound Training: A Randomized Controlled Trial10.1016/j.ultrasmedbio.2022.08.012 ↗
19. Improving safety outcomes through medical error reduction via virtual reality-based clinical skills training10.1016/j.ssci.2023.106200 ↗
20. A high-resolution virtual reality-based simulator to enhance perioperative echocardiography training10.1053/j.jvca.2022.09.004 ↗
21. Kim, J.S., Kim, K.W., Kim, S.R., Woo, T.G., Chung, J.W., Yang, S.W., and Moon, S.Y. (2024). An Immersive Virtual Reality Simulator for Echocardiography Examination. Appl. Sci., 14.10.3390/app14031272 ↗
22. Reinschluessel, A.V., Muender, T., Salzmann, D., Doering, T., Malaka, R., and Weyhe, D. (2022). Virtual reality for surgical planning–evaluation based on two liver tumor resections. Front. Surg., 9.10.3389/fsurg.2022.821060 ↗
23. Virtual and augmented reality in cardiac surgery
24. Essential surgical plan modifications after virtual reality planning in 50 consecutive segmentectomies10.1016/j.athoracsur.2022.08.037 ↗
25. Virtual and augmented reality in spine surgery: A systematic review10.1016/j.wneu.2023.02.068 ↗
26. A review of virtual reality in radiology10.1067/j.cpradiol.2023.10.006 ↗
27. The impact of 3D virtual reality radiography practice on student performance in clinical practice10.1016/j.radi.2022.10.033 ↗
28. Healthcare applications of Augmented Reality (AR) and Virtual Real-ity (VR) simulation in clinical ceducation
29. Gan, W., Mok, T.N., Chen, J., She, G., Zha, Z., Wang, H., Li, H., Li, J., and Zheng, X. (2023). Researching the application of virtual reality in medical education: One-year follow-up of a randomized trial. BMC Med. Educ., 23.10.1186/s12909-022-03992-6 ↗
30. Surgical planning in virtual reality: A systematic review10.1117/1.JMI.11.6.062603 ↗
31. Ujiie, H., Chiba, R., Yamaguchi, A., Nomura, S., Shiiya, H., Fujiwara-Kuroda, A., Kaga, K., Eitel, C., Clapp, T.R., and Kato, T. (2024). Developing a Virtual Reality Simulation System for Preoperative Planning of Robotic-Assisted Thoracic Surgery. J. Clin. Med., 13.10.20944/preprints202401.0527.v1 ↗
32. Augmented reality microsurgery: A tool for training micromanipulations in ophthalmic surgery using augmented reality10.1097/SIH.0000000000000413 ↗
33. Rhienmora, P., Gajananan, K., Haddawy, P., Dailey, M.N., and Suebnukarn, S. (2010, January 22–24). Augmented reality haptics system for dental surgi-cal skills training. Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology, Hong Kong, China.10.1145/1889863.1889883 ↗
34. Kata, H., and Billinghurst, M. (1999, January 20–21). Marker tracking and hmd calibration for a video-based augmented reality conferencing system. Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR’99), San Francisco, CA, USA.
35. Si, W.X., Liao, X.Y., Qian, Y.L., Sun, H.T., Chen, X.D., Wang, Q., and Heng, P.A. (2019). Assessing performance of augmented reality-based neurosurgical training. Vis. Comput. Ind. Biomed. Art, 2.10.1186/s42492-019-0015-8 ↗
36. (2023, November 17). Microsoft. Available online: https://www.microsoft.com/en-us/hololens.
37. Schott, D., Saalfeld, P., Schmidt, G., Joeres, F., Boedecker, C., Huettl, F., Lang, H., Huber, T., Preim, B., and Hansen, C. (April, January 27). A VR/AR Environment for Multi-User Liver Anatomy Education. Proceedings of the 2021 IEEE Virtual Reality and 3D User Interfaces (VR), Lisboa, Portugal.10.1109/VR50410.2021.00052 ↗
38. Interactive Anatomy-Augmented Virtual Simulation Training10.1016/j.ecns.2017.09.008 ↗
39. Augmented reality-based navigation increases precision of pedicle screw insertion10.1186/s13018-020-01690-x ↗
40. Zhu, T., Jiang, S., Yang, Z., Zhou, Z., Li, Y., Ma, S., and Zhuo, J. (2022). A neuroendoscopic navigation system based on dual-mode augmented reality for minimally invasive surgical treatment of hypertensive intracerebral hemorrhage. Comput. Biol. Med., 140.10.1016/j.compbiomed.2021.105091 ↗
41. Projected cutting guides using an augmented reality system to improve surgical margins in maxillectomies: A preclinical study10.1016/j.oraloncology.2022.105775 ↗
42. Artificial intelligence and augmented reality for guided implant surgery planning: A proof of concept10.1016/j.jdent.2023.104485 ↗
43. Augmented reality in spine surgery–past, present, and future10.1016/j.spinee.2023.08.015 ↗
44. Ock, J., Moon, S., Kim, M., Ko, B.S., and Kim, N. (2024). Evaluation of the accuracy of an augmented reality-based tumor-targeting guide for breast-conserving surgery. Comput. Methods Programs Biomed., 245.10.1016/j.cmpb.2023.108002 ↗
45. Augmented reality-based surgical navigation of pelvic screw placement: An ex-vivo experimental feasibility study10.1186/s13037-023-00385-6 ↗
46. Clinical evaluation of augmented reality-based 3D navigation system for brachial plexus tumor surgery10.1186/s12957-023-03288-z ↗
47. Augmented Reality Head-Mounted Device and Dynamic Navigation System for Postremoval in Maxillary Molars10.1016/j.joen.2024.02.004 ↗
48. Robot-assisted augmented reality surgical navigation based on optical tracking for mandibular reconstruction surgery10.1002/mp.16598 ↗
50. Slicing an ear using prune-and-search10.1016/0167-8655(93)90141-Y ↗
51. Schneider, P.J., and Eberly, D.H. (2008). Geometric Tools for Computer Graphics, Elsevier Science. [1st ed.].
52. A coefficient of agreement for nominal scales10.1177/001316446002000104 ↗
53. Measuring nominal scale agreement among many raters10.1037/h0031619 ↗