Medical Augmented-Reality Visualizer for Surgical Training and Education in Medicine
Source abstract
Abstract
This paper presents a projection-based augmented-reality system (MARVIS) that supports the visualization of internal structures on the surface of a liver phantom. MARVIS is endowed with three key features: tracking of spatial relationship between the phantom and the operator’s head in real time, monoscopic projection of internal liver structures onto the phantom surface for 3D perception without additional head-mounted devices, and phantom internal electronic circuit to assess the accuracy of a syringe guidance system. An initial validation was carried out by 25 medical students (12 males and 13 females; mean age, 23.12 years; SD, 1.27 years) and 3 male surgeons (mean age, 43.66 years; SD, 7.57 years). The validation results show that the ratio of failed syringe insertions was reduced from 50% to 30% by adopting the MARVIS projection. The proposed system suitably enhances a surgeon’s spatial perception of a phantom internal structure.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Augmented Reality Applications · Surgical Simulation and Training · Anatomy and Medical Technology
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Mechatronics Warsaw University of Technology, ul. Św, Andrzeja Boboli 8, 02-525 Warsaw, Poland
Medical University of Warsaw, Żwirki i Wigury 61, 02-091 Warsaw, Poland
Funding
National Science Centre, Poland
References (41)
Show source-provided references
1. Ma, M., Jain, L.C., and Anderson, P. (2014). Virtual, Augmented Reality and Serious Games for Healthcare 1, Springer.10.1007/978-3-642-54816-1 ↗
2. Augmented reality to promote collaborative and autonomous learning in higher education10.1016/j.chb.2014.11.093 ↗
3. Relationship between student profile, tool use, participation, and academic performance with the use of Augmented Reality technology for visualized architecture models10.1016/j.chb.2013.03.006 ↗
4. Augmented Reality in Education and Training10.1007/s11528-012-0559-3 ↗
5. Augmented Reality Trends in Education: A Systematic Review of Research and Applications
6. Pantelidis, P., Chorti, A., Papagiouvanni, I., Paparoidamis, G., Drosos, C., Panagiotakopoulos, T., Lales, G., and Sideris, M. (2018). Virtual and Augmented Reality in Medical Education. Medical and Surgical Education—Past, Present and Future, InTechOpen.10.5772/intechopen.71963 ↗
7. The learning curve in laparoscopic major liver resection10.1007/s00534-012-0571-1 ↗
8. Learning curves in surgical practice10.1136/pgmj.2007.057190 ↗
9. Surgeons and non-surgeons prefer haptic feedback of instrument vibrations during robotic surgery10.1007/s00464-014-4030-8 ↗
10. The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: A current review10.1007/s00464-008-0298-x ↗
11. Simulation training in upper tract endourology: Myth or reality?
12. Chen, H., Lee, A.S., Swift, M., and Tang, J.C. (2015, January 26–30). 3D Collaboration Method over HoloLensTM and SkypeTM End Points. Proceedings of the 23rd ACM International Conference on Multimedia, Brisbane, Australia.10.1145/2814347.2814350 ↗
13. Hua, H., Gao, C., Brown, L.D., Ahuja, N., and Rolland, J.P. (2001, January 29–30). Using a head-mounted projective display in interactive augmented environments. Proceedings of the IEEE and ACM International Symposium on Augmented Reality, Washington, DC, USA.
14. Augmented Reality Technology Using Microsoft HoloLens in Anatomic Pathology10.5858/arpa.2017-0189-OA ↗
15. Accuracy of Remote Electrocardiogram Interpretation with the Use of Google Glass Technology10.1016/j.amjcard.2014.11.008 ↗
16. Application of an augmented reality tool for maxillary positioning in orthognathic surgery—A feasibility study10.1016/j.jcms.2006.07.862 ↗
17. Rogowitz, B.E., Pappas, T.N., and Daly, S.J. (2005). Perceiving Simulated Ego-Motions in Virtual Reality: Comparing Large Screen Displays with HMDs, International Society for Optics and Photonics.
18. Lacoche, J., Le Chenechal, M., Chalme, S., Royan, J., Duval, T., Gouranton, V., Maisel, E., and Arnaldi, B. (2015, January 23–24). Dealing with frame cancellation for stereoscopic displays in 3D user interfaces. Proceedings of the 2015 IEEE Symposium on 3D User Interfaces (3DUI), Arles, France.10.1109/3DUI.2015.7131729 ↗
19. Resolving the vergence-accommodation conflict in head-mounted displays10.1109/TVCG.2015.2473855 ↗
20. Vergence—Accommodation conflicts hinder visual performance and cause visual fatigue
21. A Hybrid 2D/3D User Interface for Radiological Diagnosis10.1007/s10278-017-0002-6 ↗
22. Daher, S., Hochreiter, J., Norouzi, N., Gonzalez, L., Bruder, G., and Welch, G. (2018, January 5–8). Physical-Virtual Agents for Healthcare Simulation. Proceedings of the 18th International Conference on Intelligent Virtual Agents—IVA ’18, Sydney, Australia.10.1145/3267851.3267876 ↗
23. An augmented reality simulator for ultrasound guided needle placement training10.1007/s11517-007-0231-9 ↗
24. Coles, T.R., John, N.W., Gould, D., and Caldwell, D.G. (2011). Integrating haptics with augmented reality in a femoral palpation and needle insertion training simulation. IEEE Trans. Haptics.10.1109/TOH.2011.32 ↗
25. Fleck, S., Busch, F., Biber, P., and Straber, W. (2006, January 17–22). 3D Surveillance A Distributed Network of Smart Cameras for Real-Time Tracking and its Visualization in 3D. Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW’06), Washington, DC, USA.
26. Cui, Y., Schuon, S., Chan, D., Thrun, S., and Theobalt, C. (2010, January 13–18). 3D shape scanning with a time-of-flight camera. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.10.1109/CVPR.2010.5540082 ↗
27. Seitz, S.M., Curless, B., Diebel, J., Scharstein, D., and Szeliski, R. (2006, January 17–22). A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition—Volume 1 (CVPR’06), Washington, DC, USA.
28. A flexible new technique for camera calibration10.1109/34.888718 ↗
29. Robust geometric, phase and colour structured light projection system calibration10.1016/j.opelre.2017.10.001 ↗
30. Mayol-Cuevas, W.W., Juarez-Guerrero, J., and Munoz-Gutierrez, S. (1998, January 14). A first approach to tactile texture recognition. Proceedings of the SMC’98 Conference IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218), San Diego, CA, USA.
31. (2019, February 15). MM922 Silicone Moulding Rubbers. Available online: https://acc-silicones.com/products/moulding_rubbers/MM922.
32. Matsuhashi, T. (1990). ‘Agar’. Food Gels, Springer.10.1007/978-94-009-0755-3_1 ↗
33. Comparison of Oculus Rift and HTC Vive: Feasibility for Virtual Reality-Based Exploration, Navigation, Exergaming, and Rehabilitation10.1089/g4h.2017.0114 ↗
34. Ribo, M., Pinz, A., and Fuhrmann, A.L. (2001, January 21–23). A new optical tracking system for virtual and augmented reality applications. Proceedings of the 18th IMTC 2001 IEEE Instrumentation and Measurement Technology Conference. Rediscovering Measurement in the Age of Informatics (Cat. No.01CH 37188), Budapest, Hungary.
35. Pupil Diameter and the Depth-of-field of the Human Eye as Measured by Laser Speckle10.1080/713819479 ↗
36. Binocular sensory fusion is limited by spatial resolution10.1016/0042-6989(84)90207-4 ↗
37. Julesz, B. (1971). Foundations of Cyclopean Perception, Chicago University Press.
38. The range and scope of binocular depth discrimination in man10.1113/jphysiol.1970.sp009296 ↗
39. Repeated Vergence Adaptation Causes the Decline of Visual Functions in Watching Stereoscopic Television10.1109/JDT.2005.858938 ↗
40. The progress of high presence and 3D display technology the depth-fused 3-D display for the eye sweetly
41. Chien, L.-C. (2003). Novel 3D Display Using an Array of LCD Panels, International Society for Optics and Photonics.