Robot Control Platform for Multimodal Interactions with Humans Based on ChatGPT
Source abstract
Abstract
This paper presents the architecture of a multimodal human–robot interaction control platform that leverages the advanced language capabilities of ChatGPT to facilitate more natural and engaging conversations between humans and robots. Implemented on the Pepper humanoid robot, the platform aims to enhance communication by providing a richer and more intuitive interface. The motivation behind this study is to enhance robot performance in human interaction through cutting-edge natural language processing technology, thereby improving public attitudes toward robots, fostering the development and application of robotic technology, and reducing the negative attitudes often associated with human–robot interactions. To validate the system, we conducted experiments measuring negative attitude robot scale and their robot anxiety scale scores before and after interacting with the robot. Statistical analysis of the data revealed a significant improvement in the participants’ attitudes and a notable reduction in anxiety following the interaction, indicating that the system holds promise for fostering more positive human–robot relationships.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: AI in Service Interactions · Engineering Education and Technology · Artificial Intelligence in Healthcare and Education
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Engineering School of Digital Technologiese, EFREI, Paris-Panthéon-Assas University, 30-32 Avenue de la République, 94800 Villejuif, France
Institute of Computer Science, Faculty of Computer Science, AGH University of Krakow, al. A. Mickiewicza 30, 30-059 Krakow, Poland
Funding
Polish Ministry of Science and Technology
References (29)
Show source-provided references
1. Riskin, J. (2016). The Restless Clock: A History of the Centuries-Long Argument Over What Makes Living Things Tick, University of Chicago Press.10.7208/chicago/9780226303086.001.0001 ↗
2. Nocks, L. (2008). The Robot: The Life Story of a Technology, Johns Hopkins University Press.10.56021/9780801890710 ↗
3. Human–Robot Interaction: Status and Challenges10.1177/0018720816644364 ↗
4. Robot-assisted rehabilitation of hand function10.1097/WCO.0b013e32833e99a4 ↗
5. Sawik, B., Tobis, S., Baum, E., Suwalska, A., Kropińska, S., Stachnik, K., Pérez-Bernabeu, E., Cildoz, M., Agustin, A., and Wieczorowska-Tobis, K. (2023). Robots for Elderly Care: Review, Multi-Criteria Optimization Model and Qualitative Case Study. Healthcare, 11.10.3390/healthcare11091286 ↗
6. Underwater Robots: From Remotely Operated Vehicles to Intervention Autonomous Underwater Vehicles10.1109/MRA.2019.2908063 ↗
7. A brief overview of ChatGPT: The history, status quo and potential future development10.1109/JAS.2023.123618 ↗
8. SEO.AI (2024, June 28). How Many Users Does ChatGPT Have? Statistics & Facts (2024). Available online: https://seo.ai/blog/how-many-users-does-chatgpt-have.
9. Exploding Topics (2024, June 28). Number of ChatGPT Users (Jun 2024). Available online: https://explodingtopics.com/blog/chatgpt-users.
10. Sołtysik, M., Gawłowska, M., Sniezynski, B., and Gunia, A. (2024). Artificial Intelligence, Management and Trust, Routledge.10.4324/9781003311409 ↗
11. A mass-produced sociable humanoid robot: Pepper: The first machine of its kind10.1109/MRA.2018.2833157 ↗
12. Siegel, M., Breazeal, C., and Norton, M.I. (2009, January 11–15). Persuasive robotics: The influence of robot gender on human behavior. Proceedings of the 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, St Louis, MO, USA.10.1109/IROS.2009.5354116 ↗
13. Gardecki, A., Podpora, M., Beniak, R., and Klin, B. (2018, January 18–22). The Pepper humanoid robot in front desk application. Proceedings of the 2018 Progress in Applied Electrical Engineering (PAEE), Koscielisko, Poland.10.1109/PAEE.2018.8441069 ↗
14. Artificial intelligence, cyber-threats and Industry 4.0: Challenges and opportunities10.1007/s10462-020-09942-2 ↗
15. Data-driven smart manufacturing10.1016/j.jmsy.2018.01.006 ↗
16. Towards smart factory for industry 4.0: A self-organized multi-agent system with big data based feedback and coordination10.1016/j.comnet.2015.12.017 ↗
17. A Review of the Reliability Analysis of the Complex Industrial Systems
18. Chatgpt for robotics: Design principles and model abilities10.1109/ACCESS.2024.3387941 ↗
19. Enhancing the LLM-Based Robot Manipulation Through Human-Robot Collaboration10.1109/LRA.2024.3415931 ↗
20. Kim, Y., Kim, D., Choi, J., Park, J., Oh, N., and Park, D. (2024). A Survey on Integration of Large Language Models with Intelligent Robots. Intell. Serv. Robot.10.1007/s11370-024-00550-5 ↗
21. Krägeloh, C.U., Bharatharaj, J., Sasthan Kutty, S.K., Nirmala, P.R., and Huang, L. (2019). Questionnaires to measure acceptability of social robots: A critical review. Robotics, 8.10.3390/robotics8040088 ↗
22. A systematic review of attitudes, anxiety, acceptance, and trust towards social robots10.1007/s12369-020-00659-4 ↗
23. Nomura, T., Kanda, T., Suzuki, T., and Kato, K. (2004, January 20–22). Psychology in human-robot communication: An attempt through investigation of negative attitudes and anxiety toward robots. Proceedings of the RO-MAN 2004, 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No. 04TH8759), Kurashiki, Japan.
24. Nomura, T., Suzuki, T., Kanda, T., and Kato, K. (2006, January 6–8). Measurement of anxiety toward robots. Proceedings of the ROMAN 2006—15th IEEE International Symposium on Robot and Human Interactive Communication, Hatfield, UK.10.1109/ROMAN.2006.314462 ↗
25. Polish version of the negative attitude toward robots scale (NARS-PL)
26. Nomura, T., Kanda, T., Yamada, S., and Suzuki, T. (2011, January 8–11). Exploring influences of robot anxiety into HRI. Proceedings of the 6th International Conference on Human-Robot Interaction, Lausanne, Switzerland.10.1145/1957656.1957737 ↗
27. Multi-Platform Intelligent System for Multimodal Human-Computer Interaction10.31577/cai_2021_1_83 ↗
28. The uncanny valley [from the field]10.1109/MRA.2012.2192811 ↗
29. Cohen, J. (2013). Statistical Power Analysis for the Behavioral Sciences, Routledge. [2nd ed.].10.4324/9780203771587 ↗