Patient–Robot Co-Navigation of Crowded Hospital Environments
Source abstract
Abstract
Intelligent multi-purpose robotic assistants have the potential to assist nurses with a variety of non-critical tasks, such as object fetching, disinfecting areas, or supporting patient care. This paper focuses on enabling a multi-purpose robot to guide patients while walking. The proposed robotic framework aims at enabling a robot to learn how to navigate a crowded hospital environment while maintaining contact with the patient. Two deep reinforcement learning models are developed; the first model considers only dynamic obstacles (e.g., humans), while the second model considers static and dynamic obstacles in the environment. The models output the robot’s velocity based on the following inputs; the patient’s gait velocity, which is computed based on a leg detection method, spatial and temporal information from the environment, the humans in the scene, and the robot. The proposed models demonstrate promising results. Finally, the model that considers both static and dynamic obstacles is successfully deployed in the Gazebo simulation environment.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotic Path Planning Algorithms · Social Robot Interaction and HRI · Context-Aware Activity Recognition Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Human-Machine Interaction & Innovation (HMI2) Lab, Santa Clara University, 500 El Camino Real, Santa Clara, CA 95053, USA
Funding
National Science Foundation
References (58)
Show source-provided references
1. U.S. Bureau of Labor Statistics (2023, February 02). Occupational Employment and Wages, Available online: https://www.bls.gov/ooh/healthcare/registered-nurses.htm.
2. Hall, L.H., Johnson, J., Watt, I., Tsipa, A., and O’Connor, D.B. (2016). Healthcare staff wellbeing, burnout, and patient safety: A systematic review. PLoS ONE, 11.10.1371/journal.pone.0159015 ↗
3. Nurse burnout and quality of care: Cross-national investigation in six countries10.1002/nur.20383 ↗
4. Work stress among Chinese nurses to support Wuhan in fighting against COVID-19 epidemic10.1111/jonm.13014 ↗
5. Kaiser, M.S., Al Mamun, S., Mahmud, M., and Tania, M.H. (2021). COVID-19: Prediction, Decision-Making, and Its Impacts, Springer.
6. Robotics applications in COVID-19: A review10.1142/S2424862220300033 ↗
7. Kyrarini, M., Lygerakis, F., Rajavenkatanarayanan, A., Sevastopoulos, C., Nambiappan, H.R., Chaitanya, K.K., Babu, A.R., Mathew, J., and Makedon, F. (2021). A Survey of Robots in Healthcare. Technologies, 9.10.3390/technologies9010008 ↗
8. Qassim, H.M., and Wan Hasan, W. (2020). A review on upper limb rehabilitation robots. Appl. Sci., 10.10.3390/app10196976 ↗
9. A review on lower limb rehabilitation exoskeleton robots10.1186/s10033-019-0389-8 ↗
10. The effects of assistive walking robots for health care support on older persons: A preliminary field experiment in an elder care facility10.1007/s11370-020-00345-4 ↗
11. Human vital sign determination using tactile sensing and fuzzy triage system10.1016/j.eswa.2021.114781 ↗
12. Kim, W., Balatti, P., Lamon, E., and Ajoudani, A. (August, January 31). MOCA-MAN: A MObile and reconfigurable Collaborative Robot Assistant for conjoined huMAN-robot actions. Proceedings of the IEEE International Conference on Robotics and Automation, Paris, France.
13. A teleoperation interface for loco-manipulation control of mobile collaborative robotic assistant10.1109/LRA.2019.2928757 ↗
14. Nambiappan, H.R., Kodur, K.C., Kyrarini, M., Makedon, F., and Gans, N. (July, January 29). MINA: A Multitasking Intelligent Nurse Aid Robot. Proceedings of the The 14th PErvasive Technologies Related to Assistive Environments Conference, Corfu, Greece.
15. Kodur, K.C., Rajpathak, K., Rajavenkatanarayanan, A., Kyrarini, M., and Makedon, F. (2021). Towards a Multi-purpose Robotic Nursing Assistant. arXiv.
16. Rajpathak, K., Kodur, K.C., Kyrarini, M., and Makedon, F. (July, January 29). End-User Framework for Robot Control. Proceedings of the 14th PErvasive Technologies Related to Assistive Environments Conference, Corfu, Greece.
17. Nambiappan, H.R., Arboleda, S.A., Lundberg, C.L., Kyrarini, M., Makedon, F., and Gans, N. (2022). MINA: A Robotic Assistant for Hospital Fetching Tasks. Technologies, 10.10.3390/technologies10020041 ↗
18. Reinforcement learning: A survey10.1613/jair.301 ↗
19. Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., and Ng, A.Y. (2009, January 19–21). ROS: An open-source Robot Operating System. Proceedings of the ICRA Workshop on Open Source Software, Kobe, Japan.
20. Overground robot based gait rehabilitation system MOPASS - Overview and first results from usability testing
21. Wearable robotic exoskeleton for gait reconstruction in patients with spinal cord injury: A literature review
22. Feasibility of robot-based perturbed-balance training during treadmill walking in a high-functioning chronic stroke subject: A case-control study
23. Robot-assisted therapy for balance function rehabilitation after stroke: A systematic review and meta-analysis10.1016/j.ijnurstu.2019.03.015 ↗
24. Chalvatzaki, G., Koutras, P., Hadfield, J., Papageorgiou, X.S., Tzafestas, C.S., and Maragos, P. (2019, January 20–24). Lstm-based network for human gait stability prediction in an intelligent robotic rollator. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.10.1109/ICRA.2019.8793899 ↗
25. A robotic cane for balance maintenance assistance10.1109/TII.2019.2903893 ↗
26. ARNA, a Service robot for Nursing Assistance: System Overview and User Acceptability
27. Visual Environment perception for obstacle detection and crossing of lower-limb exoskeletons
28. Ruiz-Ruiz, F.J., Giammarino, A., Lorenzini, M., Gandarias, J.M., Gomez-de Gabriel, J.M., and Ajoudani, A. (2021). Improving Standing Balance Performance through the Assistance of a Mobile Collaborative Robot. arXiv.10.1109/ICRA46639.2022.9812284 ↗
29. Garcia, F., Pandey, A.K., and Fattal, C. (2019). Wait for me! Towards socially assistive walk companions. arXiv.
30. Safe Guidance for a Walking-Assistant Robot Using Gait Estimation and Obstacle Avoidance10.1109/TMECH.2017.2742545 ↗
31. Wenzel, P., Schön, T., Leal-Taixé, L., and Cremers, D. (June, January 30). Vision-Based Mobile Robotics Obstacle Avoidance With Deep Reinforcement Learning. Proceedings of the IEEE International Conference on Robotics and Automation, Xi’an, China.
32. Deep reinforcement learning based mobile robot navigation: A review10.26599/TST.2021.9010012 ↗
33. Reinforcement learning-based dynamic obstacle avoidance and integration of path planning10.1007/s11370-021-00387-2 ↗
34. Haarnoja, T., Zhou, A., Abbeel, P., and Levine, S. (2018). Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor. arXiv.
35. Rosmann, C., Hoffmann, F., and Bertram, T. (2015, January 15–17). Timed-Elastic-Bands for time-optimal point-to-point nonlinear model predictive control. Proceedings of the 2015 European Control Conference, ECC 2015, Linz, Austria.10.1109/ECC.2015.7331052 ↗
36. The dynamic window approach to collision avoidance10.1109/100.580977 ↗
37. SocNavBench: A Grounded Simulation Testing Framework for Evaluating Social Navigation
38. Crowds by Example10.1111/j.1467-8659.2007.01089.x ↗
39. Pellegrini, S., Ess, A., Schindler, K., and Gool, L.V. (October, January 29). You’ll never walk alone: Modeling social behavior for multi-target tracking. Proceedings of the IEEE International Conference on Computer Vision, Kyoto, Japan.
40. Chen, C., Liu, Y., Kreiss, S., and Alahi, A. (2018, January 20–24). Crowd-Robot Interaction: Crowd-aware Robot Navigation with Attention-based Deep Reinforcement Learning. Proceedings of the IEEE International Conference on Robotics and Automation, Montreal, QC, Canada.10.1109/ICRA.2019.8794134 ↗
41. Reciprocal n-Body Collision Avoidance10.1007/978-3-642-19457-3_1 ↗
42. Liu, L., Dugas, D., Cesari, G., Siegwart, R., and Dube, R. (January, January 24). Robot navigation in crowded environments using deep reinforcement learning. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Las Vegas, NV, USA.
43. Liu, S., Chang, P., Liang, W., Chakraborty, N., and Driggs-Campbell, K. (June, January 30). Decentralized Structural-RNN for Robot Crowd Navigation with Deep Reinforcement Learning. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Xi’an, China.
44. Jain, A., Zamir, A.R., Savarese, S., and Saxena, A. (2016). Structural-RNN: Deep Learning on Spatio-Temporal Graphs. arXiv.10.1109/CVPR.2016.573 ↗
45. Vemula, A., Muelling, K., and Oh, J. (2018). Social Attention: Modeling Attention in Human Crowds. arXiv.10.1109/ICRA.2018.8460504 ↗
46. Joosse, M., Lohse, M., Berkel, N.V., Sardar, A., and Evers, V. (2021). Making Appearances: How Robots Should Approach People. ACM Trans. Hum. Robot Interact., 1–24.10.1145/3385121 ↗
47. Brett Sears (2023, March 05). Muscle Strength Scale in Physical Therapy. Available online: https://www.verywellhealth.com/muscle-strength-measurement-2696427.
48. Fully convolutional networks for semantic segmentation10.1109/TPAMI.2016.2572683 ↗
49. Benchmark dataset for evaluation of range-Based people tracker classifiers in mobile robots10.3389/fnbot.2017.00072 ↗
50. Yang, S., and Baum, M. (2017, January 5–9). Extended Kalman filter for extended object tracking. Proceedings of the ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing, New Orleans, LA, USA.10.1109/ICASSP.2017.7952985 ↗
51. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention Is All You Need. arXiv.
52. Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal Policy Optimization Algorithms. arXiv.
53. Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, A Bradford Book.
54. Koenig, N., and Howard, A. (October, January 28). Design and use paradigms for gazebo, an open-source multi-robot simulator. Proceedings of the 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)(IEEE Cat. No. 04CH37566), Sendai, Japan.
55. Social Force Model for Pedestrian Dynamics10.1103/PhysRevE.51.4282 ↗
56. Jocher, G., Stoken, A., Borovec, J., Changyu, L., and Hogan, A. (2023, March 30). ultralytics/yolov5: V3.1—Bug Fixes and Performance Improvements. Zenodo. Available online: https://doi.org/10.5281/zenodo.4154370.
57. Where to next? The impact of COVID-19 on human-robot interaction research
58. Poulinakis, K., Drikakis, D., Kokkinakis, I.W., and Spottswood, S.M. (2023). Machine-Learning Methods on Noisy and Sparse Data. Mathematics, 11.10.3390/math11010236 ↗