journal article·2023-03-11Open access

A Medical Image Visualization Technique Assisted with AI-Based Haptic Feedback for Robotic Surgery and Healthcare

Georgios M. Minopoulos, Vasileios A. Memos, Konstantinos D. Stergiou, Christos L. Stergiou, Konstantinos E. Psannis

Applied Sciences· Volume 13· Issue 6

Abstract

A lesson learned during the pandemic is that social distancing saves lives. As it was shown recently, the healthcare industry is structured in a way that cannot protect medical staff from possible infectious diseases, such as COVID-19. Today’s healthcare services seem anachronistic and not convenient for both doctors and patients. Although there have been several advances in recent years, especially in developed countries, the need for a holistic change is imperative. Evidently, future technologies should be introduced in the health sector, where Virtual Reality, Augmented Reality, Artificial Intelligence, and Tactile Internet can have vast applications. Thus, the healthcare industry could take advantage of the great evolution of pervasive computing. In this paper, we point out the challenges from the current visualization techniques and present a novel visualization technique assisted with haptics which is enhanced with artificial intelligent algorithms in order to offer remote patient examination and treatment through robotics. Such an approach provides a more detailed method of medical image data visualization and eliminates the possibility of diseases spreading, while reducing the workload of the medical staff.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Augmented Reality Applications · Retinal Imaging and Analysis · Virtual Reality Applications and Impacts

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Applied Informatics, University of Macedonia, 54636 Thessaloniki, Greece

References (22)

Show source-provided references
1. Khosla, V. (2016). 20-Percent Doctor Included: Speculations & Musings of a Technology Optimist, Khosla Ventures. Available online: https://goo.gl/DrDg6G.
2. Assessment of the utility of mixed reality in medical education
3. An advanced simulator for orthopedic surgical training10.1007/s11548-017-1688-0 ↗
4. Challenges and opportunities on AR/VR technologies for manufacturing systems in the context of industry 4.0: A state of the art review10.1016/j.jmsy.2022.09.016 ↗
5. Douglas, D.B., Venets, D., Wilke, C., Gibson, D., Liotta, L., Petricoin, E., Beck, B., and Douglas, R. (2018). State of the Art Virtual Reality and Augmented Reality Knowhow, InTech.10.15761/BEM.1000131 ↗
6. Pooryousef, V., Brown, R., and Turkay, S. (2019, January 2–5). Shape recognition and selection in medical volume visualisation with haptic gloves. Proceedings of the 31st Australian Conference on Human-Computer-Interaction, New York, NY, USA.10.1145/3369457.3369508 ↗
7. Real-time geometry-aware augmented reality in minimally invasive surgery10.1049/htl.2017.0068 ↗
8. A new head-mounted display-based augmented reality system in neurosurgical oncology: a study on phantom10.1080/24699322.2017.1358400 ↗
9. Izard, S.G., Torres, R.S., Plaza, Ó.A., Méndez, J.A.J., and García-Peñalvo, F.J. (2020). Nextmed: Automatic Imaging Segmentation, 3D Reconstruction, and 3D Model Visualization Platform Using Augmented and Virtual Reality. Sensors, 20.10.3390/s20102962 ↗
10. Douglas, D.B., Wilke, C.A., Gibson, J.D., Boone, J.M., and Wintermark, M. (2017). Augmented reality: Advances in diagnostic imaging. Multimodal Technol. Interact., 1.10.3390/mti1040029 ↗
11. Augmented reality intravenous injection simulator based 3D medical imaging for veterinary medicine10.1016/j.tvjl.2012.09.015 ↗
12. Using a depth-sensing infrared camera system to access and manipulate medical imaging from within the sterile operating field10.1503/cjs.035311 ↗
13. Addison, A.P., Addison, P.S., Smit, P., Jacquel, D., and Borg, U.R. (2021). Noncontact Respiratory Monitoring Using Depth Sensing Cameras: A Review of Current Literature. Sensors, 21.10.3390/s21041135 ↗
14. Zharovskikh, A. (2020). The Role of Computer Vision in AR and VR, InData Labs.
15. Morris, D., Tan, H., Barbagli, F., Chang, T., and Salisbury, K. (2007, January 22–24). Haptic feedback enhances force skill learning. Proceedings of the IEEE 2nd Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC), Tsukaba, Japan.10.1109/WHC.2007.65 ↗
16. Questions for artificial intelligence in health care10.1001/jama.2018.18932 ↗
17. Artificial intelligence—the revolution hasn’t happened yet
18. Qualification of a chemotherapy-compounding robot10.1177/1078155219843322 ↗
19. Minopoulos, G., and Psannis, K.E. (IEEE Consumer Electronics Magazine, 2022). Opportunities and Challenges of Tangible XR Applications for 5G Networks and Beyond, IEEE Consumer Electronics Magazine.10.1109/MCE.2022.3156305 ↗
20. Soldani, D., Fadini, F., Rasanen, H., Duran, J., Niemela, T., Chandramouli, D., Hoglund, T., Doppler, K., Himanen, T., and Laiho, J. (2017, January 4–7). 5G Mobile Systems for Healthcare. Proceedings of the IEEE 85th Vehicular Technology Conference (VTC Spring), Sydney, Australia.10.1109/VTCSpring.2017.8108602 ↗
21. A Survey on Haptic Data Over 5G Networks10.33832/ijfgcn.2019.12.2.04 ↗
22. Minopoulos, G.M., Memos, V.A., Stergiou, C.L., Stergiou, K.D., Plageras, A.P., Koidou, M.P., and Psannis, K.E. (2022). Exploitation of Emerging Technologies and Advanced Networks for a Smart Healthcare System. Appl. Sci., 12.10.3390/app12125859 ↗