Review of Advanced Medical Telerobots
Source abstract
Abstract
The advent of telerobotic systems has revolutionized various aspects of the industry and human life. This technology is designed to augment human sensorimotor capabilities to extend them beyond natural competence. Classic examples are space and underwater applications when distance and access are the two major physical barriers to be combated with this technology. In modern examples, telerobotic systems have been used in several clinical applications, including teleoperated surgery and telerehabilitation. In this regard, there has been a significant amount of research and development due to the major benefits in terms of medical outcomes. Recently telerobotic systems are combined with advanced artificial intelligence modules to better share the agency with the operator and open new doors of medical automation. In this review paper, we have provided a comprehensive analysis of the literature considering various topologies of telerobotic systems in the medical domain while shedding light on different levels of autonomy for this technology, starting from direct control, going up to command-tracking autonomous telerobots. Existing challenges, including instrumentation, transparency, autonomy, stochastic communication delays, and stability, in addition to the current direction of research related to benefit in telemedicine and medical automation, and future vision of this technology, are discussed in this review paper.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Teleoperation and Haptic Systems · Soft Robotics and Applications · Healthcare Technology and Patient Monitoring
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical and Computer Engineering, New York University (NYU), Brooklyn, NY 11201, USA
Advanced Robotics and Controls Lab, University of San Diego, San Diego, CA 92110, USA
Ampère, INSA Lyon, CNRS (UMR5005), F69621 Villeurbanne, France
Department of Mechanical and Aerospace Engineering, New York University (NYU), Brooklyn, NY 11201, USA
NYU WIRELESS, Brooklyn, NY 11201, USA
References (100+)
Show source-provided references
1. Atashzar, S.F., Naish, M., and Patel, R.V. (2018). Active Sensorimotor Augmentation in Robotics-Assisted Surgical Systems. Mixed and Augmented Reality in Medicine, CRC Press.10.1201/9781315157702-5 ↗
2. Dexterity enhancement with robotic surgery
3. Atashzar, S.F., and Patel, R.V. (2018). Teleoperation for Minimally Invasive Robotics-Assisted Surgery. The Encyclopedia of Medical Robotics, World Scientific.10.1142/9789813232266_0012 ↗
4. A Systematic Review of Multilateral Teleoperation Systems10.1109/TOH.2018.2818134 ↗
5. Surgical robotics: Impact of motion scaling on task performance10.1016/j.jamcollsurg.2004.08.027 ↗
6. Application of haptic feedback to robotic surgery10.1089/1092642041255441 ↗
7. A passivity-based approach for stable patient–robot interaction in haptics-enabled rehabilitation systems: Modulated time-domain passivity control10.1109/TCST.2016.2594584 ↗
8. Telerehabilitation: Review of the State-of-the-Art and Areas of Application10.2196/rehab.7511 ↗
9. Albakri, A. (2015). Haptic Teleoperation for Robotic-Assisted Surgery. [Ph.D. Thesis, Université de Montpellier].
10. Towards robust 3D visual tracking for motion compensation in beating heart surgery10.1016/j.media.2010.12.002 ↗
11. Robotic motion compensation for beating heart intracardiac surgery10.1177/0278364909104065 ↗
12. Integration of new features for telerobotic surgery into the MiroSurge system10.1155/2011/635951 ↗
13. A quasi-spherical triangle-based approach for efficient 3-D soft-tissue motion tracking10.1109/TMECH.2012.2203919 ↗
14. An Ultrasound Robotic System Using the Commercial Robot UR510.3389/frobt.2016.00001 ↗
15. Krupa, A., Folio, D., Novales, C., Vieyres, P., and Li, T. (2014). Robotized Tele-Echography: An Assisting Visibility Tool to Support Expert Diagnostic. Syst. J. IEEE.
16. Tele-echography of moving organs using an Impedance-controlled telerobotic system10.1016/j.mechatronics.2017.05.006 ↗
17. Computed-Torque Control for Robotic-Assisted Tele-Echography Based on Perceived Stiffness Estimation10.1109/TASE.2018.2790900 ↗
18. Cardiac ultrasonography over 4G wireless networks using a tele-operated robot10.1049/htl.2016.0043 ↗
19. Seo, J., Cho, J.H., Lee, M.W., Kim, T., Par, H., Kim, S., Kim, C., and Kwon, O. (July, January 28). Feasibility Evaluation of Mobile Internet based Robot-assisted Tele-echography System. Proceedings of the 2018 15th International Conference on Ubiquitous Robots (UR), Jeju, Korea.10.1109/URAI.2018.8441922 ↗
20. Three-dimensional imaging improves surgical performance for both novice and experienced operators using the da Vinci Robot System10.1016/j.amjsurg.2006.06.042 ↗
21. Real-time near-infrared (NIR) fluorescent cholangiography in single-site robotic cholecystectomy (SSRC): A single-institutional prospective study10.1007/s00464-012-2733-2 ↗
22. Novel robotic da Vinci instruments for laparoendoscopic single-site surgery10.1016/j.urology.2010.06.070 ↗
23. Intuitive Surgical, Inc. (2020). Da Vinci by Intuitive: Enabling Surgical Care to Get Patients Back to What Matters, Intuitive Surgical, Inc.
24. A robot with improved absolute positioning accuracy for CT guided stereotactic brain surgery10.1109/10.1354 ↗
25. Industrial robots for teleoperated surgery—A systematic review of existing approaches10.1515/cdbme-2019-0039 ↗
26. Feng, D.D. (2020). Chapter Nineteen—Medical robotics and computer-integrated interventional medicine. Biomedical Information Technology, Biomedical Engineering, Academic Press. [2nd ed.].
27. Telesurgery: Past, Present, and Future
28. Haptic Training Simulation10.3389/frvir.2020.00003 ↗
29. Robotic laparoscopic surgery: A comparison of the da Vinci and Zeus systems10.1016/S0090-4295(01)01423-6 ↗
30. A comparison of total laparoscopic hysterectomy to robotically assisted hysterectomy: Surgical outcomes in a community practice10.1016/j.jmig.2008.01.008 ↗
31. Assessment of tissue damage due to mechanical stresses10.1177/0278364907082847 ↗
32. Kuo, C.H., and Dai, J.S. (2009). Robotics for minimally invasive surgery: A historical review from the perspective of kinematics. International Symposium on History of Machines and Mechanisms, Springer.10.1007/978-1-4020-9485-9_24 ↗
33. Array of robots augmenting the kinematics of endocavitary surgery10.1109/TMECH.2013.2296531 ↗
34. Remote minimally invasive surgery–haptic feedback and selective automation in medical robotics10.1155/2011/765172 ↗
35. Haptics in minimally invasive surgery—A review10.1080/13645700701820242 ↗
36. Force sensing and its application in minimally invasive surgery and therapy: A survey10.1243/09544062JMES1917 ↗
37. Patients benefit while surgeons suffer: An impending epidemic10.1016/j.jamcollsurg.2009.10.017 ↗
38. A survey of static and dynamic work postures of operating room staff10.1007/BF00386939 ↗
39. Ergonomics, engineering and surgery of endosurgical dissection
40. Effects of visual force feedback on robot-assisted surgical task performance10.1016/j.jtcvs.2007.08.043 ↗
41. Force feedback benefit depends on experience in multiple degree of freedom robotic surgery task10.1109/TRO.2007.904891 ↗
42. Robotically assisted laparoscopic surgery10.1007/BF02909496 ↗
43. A telerobotic assistant for laparoscopic surgery10.1109/51.391776 ↗
44. Cornella, J., Elle, O.J., Ali, W., and Samset, E. (July, January 30). Improving Cartesian position Accuraca of a telesurgical robot. Proceedings of the 2008 IEEE International Symposium on Industrial Electronics, Cambridge, UK.10.1109/ISIE.2008.4677078 ↗
45. Kim, K.C. (2014). Robotics and Remote Surgery: Next Step. Robotics in General Surgery, Springer.10.1007/978-1-4614-8739-5 ↗
46. Miniaturized Instruments for the da Vinci Research Kit: Design and Implementation of Custom Continuum Tools10.1109/MRA.2017.2680547 ↗
47. The golden age of minimally invasive cardiothoracic surgery: Current and future perspectives10.2217/fca.11.23 ↗
48. Patel, R.V. (2018). The Da Vinci Surgical System. Encyclopedia Of Medical Robotics, World Scientific.
49. Rosen, J., Hannaford, B., and Satava, R.M. (2011). Surgical Robotics: Systems Applications and Visions, Springer.10.1007/978-1-4419-1126-1 ↗
50. Pak, R., de Visser, E.J., and Rovira, E. (2020). Chapter 1—Transparent interaction and human–robot collaboration for military operations. Living with Robots, Academic Press.10.1016/B978-0-12-815367-3.00001-3 ↗
51. Impact of robot-assisted spine surgery on health care quality and neurosurgical economics: A systemic review10.1007/s10143-018-0971-z ↗
52. Longmore, S., Naik, G., and Gargiulo, G. (2020). Laparoscopic robotic surgery: Current perspective and future directions. Robotics, 9.10.3390/robotics9020042 ↗
53. The future of robotic surgery in otolaryngology—Head and neck surgery10.1016/j.oraloncology.2019.104510 ↗
54. Teleoperation, telerobotics and telepresence: A progress report10.1016/0967-0661(94)00078-U ↗
55. Methods for haptic feedback in teleoperated robot-assisted surgery10.1108/01439910410566362 ↗
56. Establishment of the world’s first telerobotic remote surgical service: For provision of advanced laparoscopic surgery in a rural community10.1097/01.sla.0000154456.69815.ee ↗
57. Takács, A., Jordán, S., Nagy, D.A., Tar, J.K., Rudas, I.J., and Haidegger, T. (2015, January 21–23). Surgical robotics—Born in space. Proceedings of the 2015 IEEE 10th Jubilee International Symposium on Applied Computational Intelligence and Informatics, Timisoara, Romania.
58. Bilateral teleoperation: An historical survey10.1016/j.automatica.2006.06.027 ↗
59. Zaffino, P., Moccia, S., De Momi, E., and Spadea, M.F. (2020). A Review on Advances in Intra-operative Imaging for Surgery and Therapy: Imagining the Operating Room of the Future. Ann. Biomed. Eng.10.1007/s10439-020-02553-6 ↗
60. Robotic system for MRI-guided prostate biopsy: Feasibility of teleoperated needle insertion and ex vivo phantom study10.1007/s11548-011-0598-9 ↗
61. Shang, W., Su, H., Li, G., and Fischer, G.S. (2013, January 3–7). Teleoperation system with hybrid pneumatic-piezoelectric actuation for MRI-guided needle insertion with haptic feedback. Proceedings of the 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.
62. Stereotactic Systems for MRI-Guided Neurosurgeries: A State-of-the-Art Review10.1007/s10439-018-02158-0 ↗
63. McDaniel, T., and Panchanathan, S. (2020). Applications of Haptics in Medicine. Haptic Interfaces for Accessibility, Health, and Enhanced Quality of Life, Springer International Publishing.10.1007/978-3-030-34230-2 ↗
64. A small-gain approach for nonpassive bilateral telerobotic rehabilitation: Stability analysis and controller synthesis10.1109/TRO.2016.2623336 ↗
65. Manipulator design and operation of a six-degree-of-freedom handheld tremor-canceling microsurgical instrument10.1109/TMECH.2014.2320858 ↗
66. A Steady-Hand Robotic System for Microsurgical Augmentation10.1177/02783649922067807 ↗
67. Active Constraints/Virtual Fixtures: A Survey10.1109/TRO.2013.2283410 ↗
68. Spatial motion constraints using virtual fixtures generated by anatomy10.1109/TRO.2006.886838 ↗
69. Vision-assisted control for manipulation using virtual fixtures10.1109/TRO.2004.829483 ↗
70. Haptic feedback for control and active constraints in contactless laser surgery: Concept, implementation, and evaluation10.1109/TOH.2017.2786243 ↗
71. Spatial motion constraints in medical robot using virtual fixtures generated by anatomy
72. Artificial intelligence, robotics and eye surgery: Are we overfitted?10.1186/s40942-019-0202-y ↗
73. Robotic endoscopic surgery of the skull base: A novel surgical approach10.1001/archotol.133.12.1209 ↗
74. Robotic assistance systems for surgery: Current developments and focus of research
75. Florez, J.M., Szewczyk, J., and Morel, G. (2012, January 14–18). An impedance control strategy for a hand-held instrument to compensate for physiological motion. Proceedings of the 2012 IEEE International Conference on Robotics and Automation, Saint Paul, MN, USA.10.1109/ICRA.2012.6225103 ↗
76. Patel, V., Krishnan, S., Goncalves, A., Chen, C., Boyd, W.D., and Goldberg, K. (2018, January 1–3). Using intermittent synchronization to compensate for rhythmic body motion during autonomous surgical cutting and debridement. Proceedings of the 2018 International Symposium on Medical Robotics (ISMR), Atlanta, GA, USA.10.1109/ISMR.2018.8333301 ↗
77. Pandya, A., Eslamian, S., Ying, H., Nokleby, M., and Reisner, L.A. (2019). A Robotic Recording and Playback Platform for Training Surgeons and Learning Autonomous Behaviors Using the da Vinci Surgical System. Robotics, 8.10.3390/robotics8010009 ↗
78. Play Me Back: A Unified Training Platform for Robotic and Laparoscopic Surgery10.1109/LRA.2018.2890209 ↗
79. Deep learning with convolutional neural network for objective skill evaluation in robot-assisted surgery10.1007/s11548-018-1860-1 ↗
80. Stability and transparency in bilateral teleoperation10.1109/70.258054 ↗
81. Hastrudi-Zaad, K., and Salcudean, S.E. (1999, January 10–15). On the use of local force feedback for transparent teleoperation. Proceedings of the 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C), Detroit, MI, USA.
82. Stable adaptive teleoperation10.1109/48.64895 ↗
83. Application of wave-variable control to bilateral teleoperation systems: A survey10.1016/j.arcontrol.2014.03.002 ↗
84. Time-domain passivity control of haptic interfaces10.1109/70.988969 ↗
85. A grasp-based passivity signature for haptics-enabled human-robot interaction: Application to design of a new safety mechanism for robotic rehabilitation10.1177/0278364916689139 ↗
86. Escobar-Castillejos, D., Noguez, J., Neri, L., Magana, A., and Benes, B. (2016). A Review of Simulators with Haptic Devices for Medical Training. J. Med. Syst., 40.10.1007/s10916-016-0459-8 ↗
87. Micron: An actively stabilized handheld tool for microsurgery10.1109/TRO.2011.2169634 ↗
88. Hybrid position/force control of an active handheld micromanipulator for membrane peeling10.1002/rcs.1659 ↗
89. Multiactuator haptic feedback on the wrist for needle steering guidance in brachytherapy10.1109/LRA.2016.2528295 ↗
90. Raitor, M., Walker, J.M., Okamura, A.M., and Culbertson, H. (June, January 29). WRAP: Wearable, restricted-aperture pneumatics for haptic guidance. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.10.1109/ICRA.2017.7989055 ↗
91. Atashzar, S.F., Polushin, I.G., and Patel, R.V. (2012, January 7–12). Networked teleoperation with non-passive environment: Application to tele-rehabilitation. Proceedings of the 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, Vilamoura, Portugal.10.1109/IROS.2012.6386152 ↗
92. Bilateral Magnetic Micromanipulation Using Off-Board Force Sensor10.1109/TMECH.2015.2417116 ↗
93. Telerobotic-assisted bone-drilling system using bilateral control with feed operation scaling and cutting force scaling10.1002/rcs.457 ↗
94. Development of a surgical robot for cementless total hip arthroplasty10.1097/00003086-199212000-00010 ↗
95. Technique and first clinical results of robot-assisted total knee replacement10.1016/S0968-0160(02)00015-7 ↗
96. Jakopec, M., Harris, S., y Baena, F.R., Gomes, P., and Davies, B. (2002, January 3–5). Acrobot: A “hands-on” robot for total knee replacement surgery. Proceedings of the 7th International Workshop on Advanced Motion Control (Cat. No.02TH8623), Maribor, Slovenia.
97. Bonneau, E., Taha, F., Gravez, P., and Lamy, S. (2004). Surgicobot: Surgical Gesture Assistance Cobot For Maxillo-Facial Interventions. Perspective in Image-Guided Surgery, World Scientific.10.1142/9789812702678_0048 ↗
98. Tian, W. (2020). The History and Development of Robot-Assisted Orthopedic Surgery. Navigation Assisted Robotics in Spine and Trauma Surgery, Springer.10.1007/978-981-15-1846-1 ↗
99. The role of direct and visual force feedback in suturing using a 7-DOF dual-arm teleoperated system10.1109/TOH.2016.2616874 ↗
100. Effect of sensory substitution on suture-manipulation forces for robotic surgical systems10.1016/j.jtcvs.2004.05.029 ↗