Design and Implementation of a Companion Robot with LLM-Based Hierarchical Emotion Motion Generation
Source abstract
Abstract
Recently, human–robot interaction (HRI) with social robots has attracted significant attention. Among them, companion robots, which exhibit pet-like behaviors and interact with people primarily through non-verbal means, particularly require the generation of appropriate gestures. This paper presents the design and implementation of a companion cat robot, named PEPE, with a large language model (LLM)-based hierarchical emotional motion generation method. To design the cat-like companion robot, an analysis of feline emotional behaviors was conducted to identify the body parts and motions essential for effective emotional expression. Based on this analysis, the required degrees of freedom (DoFs) and structural configuration for PEPE were derived. To generate expressive gestures efficiently and reliably, a hierarchical LLM-based emotional motion generation method was proposed. The process defines the robot’s structural features, establishes a gesture generation code format, and incorporates emotion-based guidelines grounded in feline behavioral analysis to mitigate LLM hallucination and ensure physical feasibility. The proposed method was implemented on the physical robot, and eight emotional gestures were generated—Happy, Angry, Sad, Fearful, Joyful, Excited, Positive Feedback, and Negative Feedback. A user study with 15 participants was conducted to validate the system. The high-arousal gestures—Angry, Joyful, and Excited—were rated significantly above the neutral clarity threshold (p < 0.05), demonstrating clear user recognition. Meanwhile, low-arousal gestures exhibited neutral-level perceptions consistent with their subtle motion profiles. These results confirm that the proposed LLM-based framework effectively generates expressive, physically executable gestures for a companion robot.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Social Robot Interaction and HRI · Human-Animal Interaction Studies · Emotion and Mood Recognition
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Robotics Engineering Department, Korea University of Science and Technology (UST), Ansan 15588, Republic of Korea
Human-Centric Robotics R&D Department, Korea Institute of Industrial Technology (KITECH), Ansan 15588, Republic of Korea
Funding
Ministry of Trade, Industry and Energy
References (37)
Show source-provided references
1. Siciliano, B., and Khatib, O. (2016). Springer Handbook of Robotics, Springer.10.1007/978-3-319-32552-1 ↗
2. Dou, X., Yan, L., Wu, K., and Niu, J. (2022). Effects of Voice and Lighting Color on the Social Perception of Home Healthcare Robots. Appl. Sci., 12.10.3390/app122312191 ↗
3. Mårell-Olsson, E., Bensch, S., Hellström, T., Alm, H., Hyllbrant, A., Leonardson, M., and Westberg, S. (2025). Navigating the Human–Robot Interface—Exploring Human Interactions and Perceptions with Social and Telepresence Robots. Appl. Sci., 15.10.3390/app15031127 ↗
4. Nonverbal Cues in Human–Robot Interaction: A Communication Studies Perspective10.1145/3570169 ↗
5. The Uncanny Valley [From the Field]10.1109/MRA.2012.2192811 ↗
6. Robot Companion Cats for People at Home with Dementia: A qualitative case study on companotics10.1177/1471301220932780 ↗
7. Ihamäki, P., and Heljakka, K. (2021, January 5–8). Robot Dog Intervention with the Golden Pup: Activating Social and Empathy Experiences of Elderly People as Part of Intergenerational Interaction. Proceedings of the 54th Hawaii International Conference on System Sciences (HICSS), Maui, HI, USA.10.24251/HICSS.2021.230 ↗
8. Feline faces: Unraveling the Social Function of Domestic Cat Facial Signals10.1016/j.beproc.2023.104959 ↗
9. (2025, October 13). How to Decode Your Cat’s Behavior. Available online: https://www.rd.com/list/how-to-decode-your-cats-behavior/.
10. (2025, October 13). Decoding Cat Body Language. Available online: https://catcaresociety.org/decoding-cat-body-language/.
11. (2025, October 13). Understanding Body Language in Cats. Available online: https://thevets.com/resources/pet-health-care/understanding-body-language-in-cats/.
12. (2025, October 13). Cat Body Language: What Your Feline Friend Is Trying to Tell You. Available online: https://www.sciencefocus.com/nature/cat-body-language.
13. (2025, October 13). How Do Cats Communicate With Each Other?. Available online: https://www.petmd.com/news/view/cat-language-101-how-do-cats-talk-each-other-37620.
14. Expression of Emotion and Intention by Robot Body Movement
15. Emotionally Expressive Dynamic Physical Behaviors in Robots10.1016/j.ijhcs.2015.01.006 ↗
16. Ding, Y., Zhang, X., Paxton, C., and Zhang, S. (2023, January 1–5). Task and Motion Planning with Large Language Models for Object Rearrangement. Proceedings of the 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Detroit, MI, USA.10.1109/IROS55552.2023.10342169 ↗
17. Wang, S., Han, M., Jiao, Z., Zhang, Z., Wu, Y.N., Zhu, S., and Liu, H. (2024, January 14–18). LLM3: Large Language Model-based Task and Motion Planning with Motion Failure Reasoning. Proceedings of the 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Abu Dhabi, United Arab Emirates.10.1109/IROS58592.2024.10801328 ↗
18. EMOTION: Expressive Motion Sequence Generation for Humanoid Robots with In-Context Learning10.1109/LRA.2025.3575983 ↗
19. Schulhoff, S., Ilie, M., Balepur, N., Kahadze, K., Liu, A., Si, C., Li, Y., Gupta, A., Han, H., and Schulhoff, S. (2025). The Prompt Report: A Systematic Survey of Prompt Engineering Techniques. arXiv.
20. Amatriain, X. (2024). Prompt Design and Engineering: Introduction and Advanced Methods. arXiv.
21. Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E.H., Le, Q.V., and Zhou, D. (2023). Chain-of-Thought Prompting Elicits Reasoning in Large Language Models. arXiv.
22. The Role of Coherent Robot Behavior and Embodiment in Emotion Perception and Recognition During Human-Robot Interaction: Experimental Study10.2196/45494 ↗
23. Löffler, D., Schmidt, N., and Tscharn, R. (2018, January 5–8). Multimodal Expression of Artificial Emotion in Social Robots Using Color, Motion and Sound. Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interacti (HRI), Chicago, IL, USA.10.1145/3171221.3171261 ↗
24. Development and application of CatFACS: Are human cat adopters influenced by cat facial expressions?10.1016/j.applanim.2017.01.005 ↗
25. Gu, S., Wang, F., Patel, N.P., Bourgeois, J.A., and Huang, J.H. (2019). A Model for Basic Emotions Using Observations of Behavior in Drosophila. Front. Psychol., 10.10.3389/fpsyg.2019.00781 ↗
26. Nunez, E., Hirokawa, M., and Suzuki, K. (2021). Design of a Huggable Social Robot with Affective Expressions Using Projected Images. Appl. Sci., 8.10.3390/app8112298 ↗
27. Liang, J., Huang, W., Xia, F., Hausman, K., Ichter, B., Florence, P., and Zeng, A. (2023). Code as Policies: Language Model Programs for Embodied Control. arXiv.10.1109/ICRA48891.2023.10160591 ↗
28. Wang, G., Xie, Y., Jiang, Y., Mandlekar, A., Xiao, C., Zhu, Y., Fan, L., and Anandkumar, A. (2023). Voyager: An Open-Ended Embodied Agent with Large Language Models. arXiv.
29. Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., and Neubig, G. (2021). Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing. arXiv.
30. Wu, X., Zhou, K., Sun, M., Wang, X., and Liu, N. (2023). A Survey of Graph Prompting Methods: Techniques, Applications, and Challenges. arXiv.
31. Jiang, B., Chen, X., Yin, F., Li, Z., YU, G., and Fan, J. (2024). MotionChain: Conversational Motion Controllers via Multimodal Prompts. arXiv.10.1007/978-3-031-73347-5_4 ↗
32. Wu, Q., Zhao, Y., Liu, X., Tai, Y., and Tang, C. (2025). Motion-Agent: A Conversational Framework for Human Motion Generation with LLMs. arXiv.
33. Sahoo, P., Singh, A.K., Saha, S., Jain, V., Mondal, S., and Chadha, A. (2025). A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications. arXiv.10.1007/979-8-8688-0569-1_4 ↗
34. Vatsal, S., and Dubey, H. (2024). A Survey of Prompt Engineering Methods in Large Language Models for Different NLP Tasks. arXiv.
35. Chang, K., Xu, S., Wang, C., Luo, Y., Liu, X., Xiao, T., and Zhu, J. (2024). Efficient Prompting Methods for Large Language Models: A Survey. arXiv.
36. Zheng, M., Pei, J., Logeswaran, L., Lee, M., and Jurgens, D. (2024). When “A Helpful Assistant” Is Not Really Helpful: Personas in System Prompts Do Not Improve Performances of Large Language Models. arXiv.10.18653/v1/2024.findings-emnlp.888 ↗
37. Lutz, M., Sen, I., Ahnert, G., Rogers, E., and Strohmaier, M. (2025). The Prompt Makes the Person(a): A Systematic Evaluation of Sociodemographic Persona Prompting for Large Language Models. arXiv.10.18653/v1/2025.findings-emnlp.1261 ↗