journal article·2024-09-09Open access

Guessing Human Intentions to Avoid Dangerous Situations in Caregiving Robots

Noé Zapata, Gerardo Pérez, Lucas Bonilla, Pedro Núñez, Pilar Bachiller, Pablo Bustos

Applied Sciences· Volume 14· Issue 17

Abstract

The integration of robots into social environments necessitates their ability to interpret human intentions and anticipate potential outcomes accurately. This capability is particularly crucial for social robots designed for human care, as they may encounter situations that pose significant risks to individuals, such as undetected obstacles in their path. These hazards must be identified and mitigated promptly to ensure human safety. This paper delves into the artificial theory of mind (ATM) approach to inferring and interpreting human intentions within human–robot interaction. We propose a novel algorithm that detects potentially hazardous situations for humans and selects appropriate robotic actions to eliminate these dangers in real time. Our methodology employs a simulation-based approach to ATM, incorporating a “like-me” policy to assign intentions and actions to human subjects. This strategy enables the robot to detect risks and act with a high success rate, even under time-constrained circumstances. The algorithm was seamlessly integrated into an existing robotics cognitive architecture, enhancing its social interaction and risk mitigation capabilities. To evaluate the robustness, precision, and real-time responsiveness of our implementation, we conducted a series of three experiments: (i) A fully simulated scenario to assess the algorithm’s performance in a controlled environment; (ii) A human-in-the-loop hybrid configuration to test the system’s adaptability to real-time human input; and (iii) A real-world scenario to validate the algorithm’s effectiveness in practical applications. These experiments provided comprehensive insights into the algorithm’s performance across various conditions, demonstrating its potential for improving the safety and efficacy of social robots in human care settings. Our findings contribute to the growing research on social robotics and artificial intelligence, offering a promising approach to enhancing human–robot interaction in potentially hazardous environments. Future work may explore the scalability of this algorithm to more complex scenarios and its integration with other advanced robotic systems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Social Robot Interaction and HRI · AI in Service Interactions · Reinforcement Learning in Robotics

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

RoboLab, Robotics and Artificial Vision, University of Extremadura, 10003 Cáceres, Spain

Funding

MCIN/AEI/10.13039/501100011033 and the European Union's NextGenerationEU/PRTR

References (35)

Show source-provided references
1. Mahdi, H., Akgun, S.A., Saleh, S., and Dautenhahn, K. (2022). A survey on the design and evolution of social robots—Past, present and future. Robot. Auton. Syst., 156.10.1016/j.robot.2022.104193 ↗
2. Tewari, M., and Lindgren, H. (2022). Expecting, understanding, relating, and interacting-older, middle-aged and younger adults’ perspectives on breakdown situations in human–robot dialogues. Front. Robot. AI, 9.10.3389/frobt.2022.956709 ↗
3. Theory of Mind for a Humanoid Robot10.1023/A:1013298507114 ↗
4. Winfield, A.F.T. (2018). Experiments in Artificial Theory of Mind: From Safety to Story-Telling. Front. Robot. AI, 5.10.3389/frobt.2018.00075 ↗
5. Blum, C., Winfield, A.F.T., and Hafner, V.V. (2018). Simulation-Based Internal Models for Safer Robots. Front. Robot. AI, 4.10.3389/frobt.2017.00074 ↗
6. Carruthers, P., and Smith, P.K. (1996). Theories of Theories of Mind, Cambridge University Press.10.1017/CBO9780511597985 ↗
7. “Like-Me” Simulation as an Effective and Cognitively Plausible Basis for Social Robotics10.1007/s12369-009-0014-6 ↗
8. Simulation theory10.1002/wcs.33 ↗
9. Manipulating Mental States Through Physical Action10.1007/s12369-014-0234-2 ↗
10. Artificial Cognition for Social Human-Robot Interaction: An Implementation10.1016/j.artint.2016.07.002 ↗
11. (2002). Simulation Theory Versus Theory Theory: Theories Concerning the Ability to Read Minds. [Master’s Thesis, Leopold-Franzens- Universität Innsbruck].
12. Rossi, A., Andriella, A., Rossi, S., Torras, C., and Alenyà, G. (September, January 29). Evaluating the Effect of Theory of Mind on People’s Trust in a Faulty Robot. Proceedings of the 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), Napoli, Italy.10.1109/RO-MAN53752.2022.9900695 ↗
13. An architecture for ethical robots inspired by the simulation theory of cognition10.1016/j.cogsys.2017.04.002 ↗
14. Ruocco, M., Mou, W., Cangelosi, A., Jay, C., and Zanatto, D. (2021, January 9–11). Theory of Mind Improves Human’s Trust in an Iterative Human-Robot Game. Proceedings of the 9th International Conference on Human-Agent Interaction, New York, NY, USA. HAI ’21.10.1145/3472307.3484176 ↗
15. Rabinowitz, N.C., Perbet, F., Song, H.F., Zhang, C., Eslami, S.A., and Botvinick, M. (2018). Machine theory of mind. arXiv.
16. Singamaneni, P.T., Bachiller-Burgos, P., Manso, L.J., Garrell, A., Sanfeliu, A., Spalanzani, A., and Alami, R. (2023). A Survey on Socially Aware Robot Navigation: Taxonomy and Future Challenges. arXiv.10.1177/02783649241230562 ↗
17. Robot social-aware navigation framework to accompany people walking side-by-side10.1007/s10514-016-9584-y ↗
18. Robot’s Workspace Enhancement with Dynamic Human Presence for Socially-Aware Navigation
19. Mavrogiannis, C.I., Thomason, W.B., and Knepper, R.A. (2018, January 5–8). Social Momentum: A Framework for Legible Navigation in Dynamic Multi-Agent Environments. Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, New York, NY, USA. HRI ’18.10.1145/3171221.3171255 ↗
20. Skrzypczyk, K. (2021, January 23–26). Game Against Nature Based Control of an Intelligent Wheelchair with Adaptation to Pedestrians’ Behaviour. Proceedings of the 2021 25th International Conference on Methods and Models in Automation and Robotics (MMAR), Międzyzdroje, Poland.10.1109/MMAR49549.2021.9528495 ↗
21. Shvo, M., Hari, R., O’Reilly, Z., Abolore, S., Wang, S.Y.N., and McIlraith, S.A. (2022, January 23–27). Proactive Robotic Assistance via Theory of Mind. Proceedings of the 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Kyoto, Japan.10.1109/IROS47612.2022.9981627 ↗
22. Cunningham, A., Galceran, E., Mehta, D., Ferrer, G., Eustice, R., and Olson, E. (2019). MPDM: Multi-policy Decision-Making from Autonomous Driving to Social Robot Navigation. Control Strategies for Advanced Driver Assistance Systems and Autonomous Driving Functions, Springer.10.1007/978-3-319-91569-2_10 ↗
23. Koide, K., and Miura, J. (2020, January 25–29). Collision Risk Assessment via Awareness Estimation Toward Robotic Attendant. Proceedings of the 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.10.1109/IROS45743.2020.9341599 ↗
24. Torrejon, A., Zapata, N., Núnez, P., Bonilla, L., and Bustos, P. (2023, January 9–10). Shadow, an accompanying tool robot. Proceedings of the Workshop on Autonomous Systems 2023, Aranjuez, Madrid, Spain.
25. Sanz, R., Rodriguez, M., and Aguado, E. (2024, August 17). D1.3 Theory of Understanding. Available online: https://coresense.eu.
26. The CORTEX cognitive robotics architecture: Use cases10.1016/j.cogsys.2019.01.003 ↗
27. Shapiro, M., Preguiça, N., Baquero, C., and Zawirski, M. (2011). A Comprehensive Study of Convergent and Commutative Replicated Data Types, INRIA.10.1007/978-3-642-24550-3_29 ↗
28. García, J.C., Bachiller, P., Bustos, P., and Núñez, P. (2022, January 29–30). Towards the design of efficient and versatile cognitive robotic architecture based on distributed, low-latency working memory. Proceedings of the 2022 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), Santa Maria da Feira, Portugal.10.1109/ICARSC55462.2022.9784798 ↗
29. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
30. Zhou, H., Jiang, F., Si, J., and Lu, H. (2023). Joint Multi-Person Body Detection and Orientation Estimation via One Unified Embedding. arXiv.
31. Zhang, Y., Sun, P., Jiang, Y., Yu, D., Weng, F., Yuan, Z., Luo, P., Liu, W., and Wang, X. (2022, January 23–27). Bytetrack: Multi-object tracking by associating every detection box. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.10.1007/978-3-031-20047-2_1 ↗
32. Sasaki, Y. (2007). The truth of the F-measure. Teach Tutor Mater., 1.
33. Human cognition. Foundations of human reasoning in the prefrontal cortex10.1126/science.1252254 ↗
34. Kahneman, D. (2011). Thinking, Fast and Slow, Farrar, Straus and Giroux.
35. van Maris, A., Zook, N., Dogramadzi, S., Studley, M., Winfield, A., and Caleb-Solly, P. (2021). A New Perspective on Robot Ethics through Investigating Human–Robot Interactions with Older Adults. Appl. Sci., 11.10.3390/app112110136 ↗