journal article·2025-03-21Open access

Classification of Properties in Human-like Dialogue Systems Using Generative AI to Adapt to Individual Preferences

Kaori Abe, Changqin Quan, Sheng Cao, Zhiwei Luo

Applied Sciences· Volume 15· Issue 7

Abstract

As the linguistic capabilities of AI-based dialogue systems improve, their human-likeness is increasing, and their behavior no longer receives a universal evaluation. To better adapt to users, the consideration of individual preferences is required. In this study, the relationships between the properties of a human-like dialogue system and dialogue evaluations were investigated using hierarchical cluster analysis for individual subjects. The dialogue system driven by generative AI communicated with subjects in natural language via voice-based communication and featured a facial expression function. Subjective evaluations of the system and dialogues were conducted through a questionnaire. Based on the analysis results, the system properties were classified into two types: generally and individually relational to a positive evaluation of the dialogue. The former included inspiration, a sense of security, and collaboration, while the latter included a sense of distance, personality, and seriousness. Equipping the former properties is expected to improve dialogues for most users. The latter properties should be adjusted to individuals since they are evaluated based on individual preferences. A design approach in accordance with individuality could be useful for making human-like dialogue systems more comfortable for users.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: AI in Service Interactions · Speech and dialogue systems · Social Robot Interaction and HRI

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Graduate School of System Informatics, Kobe University, 1-1, Rokkodai-cho, Nada-ku, Kobe 657-8501, Japan

References (36)

Show source-provided references
1. Different chatbots for different purposes: Towards a typology of chatbots to understand interaction design
2. Durante, Z., Huang, Q., Wake, N., Gong, R., Park, J.S., Sarkar, B., Taori, R., Noda, Y., Terzopoulos, D., and Choi, Y. (2024). Agent AI: Surveying the horizons of multimodal interaction. arXiv.
3. Artificial Intelligence Chatbot Behavior Change Model for Designing Artificial Intelligence Chatbots to Promote Physical Activity and a Healthy Diet: Viewpoint10.2196/22845 ↗
4. Adding Communicative and Affective Strategies to an Embodied Conversational Agent to Enhance Second Language Learners’ Willingness to Communicate10.1007/s40593-018-0171-6 ↗
5. Herrmann-Werner, A., Festl-Wietek, T., Junne, F., Zipfel, S., and Madany Mamlouk, A. (2021). “Hello, my name is Melinda”—Students’ views on a digital assistant for navigation in digital learning environments; A qualitative interview study. Front. Educ., 5.10.3389/feduc.2020.541839 ↗
6. Evaluating large language models in theory of mind tasks10.1073/pnas.2405460121 ↗
7. Jones, C.R., and Bergen, B.K. (2024). People cannot distinguish GPT-4 from a human in a Turing test. arXiv.
8. Zhou, H., Huang, M., Zhang, T., Zhu, X., and Liu, B. (2018, January 2–7). Emotional chatting machine: Emotional conversation generation with internal and external memory. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence and Thirtieth Innovative Applications of Artificial Intelligence Conference and Eighth AAAI Symposium on Educational Advances in Artificial Intelligence, New Orleans, LU, USA.10.1609/aaai.v32i1.11325 ↗
9. The effects of health care chatbot personas with different social roles on the client-chatbot bond and usage intentions: Development of a design codebook and web-based study10.2196/32630 ↗
10. Miyanishi, T., Hirayama, J., Kanemura, A., and Kawanabe, M. (2018, January 13–19). Answering mixed type questions about daily living episodes. Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, Stockholm, Sweden.10.24963/ijcai.2018/593 ↗
11. The human side of human-chatbot interaction: A systematic literature review of ten years of research on text-based chatbots10.1016/j.ijhcs.2021.102630 ↗
12. Kätsyri, J., Förger, K., Mäkäräinen, M., and Takala, T. (2015). A review of empirical evidence on different uncanny valley hypotheses: Support for perceptual mismatch as one road to the valley of eeriness. Front. Psychol., 6.10.3389/fpsyg.2015.00390 ↗
13. Svenningsson, N., and Faraon, M. (2019, January 21–23). Artificial intelligence in conversational agents: A study of factors related to perceived humanness in chatbots. Proceedings of the 2019 2nd Artificial Intelligence and Cloud Computing Conference, Kobe, Japan.10.1145/3375959.3375973 ↗
14. Designing personality-adaptive conversational agents for mental health care10.1007/s10796-022-10254-9 ↗
15. Reeves, B., and Nass, C. (1996). The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places, Cambridge University Press.
16. Psychological, relational, and emotional effects of self-disclosure after conversations with a chatbot10.1093/joc/jqy026 ↗
17. Okada, Y., Kimoto, M., Iio, T., Shimohara, K., and Shiomi, M. (2023). Two is better than one: Apologies from two robots are preferred. PLoS ONE, 18.10.1371/journal.pone.0281604 ↗
18. Real conversations with artificial intelligence: A comparison between human-human online conversations and human-chatbot conversations10.1016/j.chb.2015.02.026 ↗
19. The media inequality: Comparing the initial human-human and human-AI social interactions10.1016/j.chb.2017.02.067 ↗
20. Why people use chatbots10.1007/978-3-319-70284-1_30 ↗
21. Abe, K., Quan, C., Cao, S., and Luo, Z. (2024, January 9–12). Subjective evaluation of dialogues with dyadic and triadic interactions using a ChatGPT-based dialogue system. Proceedings of the 2024 Joint 13th International Conference on Soft Computing and Intelligent Systems and 25th International Symposium on Advanced Intelligent Systems (SCIS&ISIS), Himeji, Japan.10.1109/SCISISIS61014.2024.10760216 ↗
22. The Wolfpack Effect: Perception of Animacy Irresistibly Influences Interactive Behavior10.1177/0956797610388814 ↗
23. Kanakogi, Y., Okumura, Y., Inoue, Y., Kitazaki, M., and Itakura, S. (2013). Rudimentary Sympathy in Preverbal Infants: Preference for Others in Distress. PLoS ONE, 8.10.1371/journal.pone.0065292 ↗
24. Influence of appearance and motion interaction on emotional state attribution to objects: The example of hugging shimeji mushrooms10.1016/j.chb.2024.108383 ↗
25. Loeffler, D., Schmidt, N., and Tscharn, R. (2018, January 5–8). Multimodal expression of artificial emotion in social robots using color, motion and sound. Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, Chicago, IL, USA.10.1145/3171221.3171261 ↗
26. Facial expressions of emotion are not culturally universal10.1073/pnas.1200155109 ↗
27. Tomasello, M. (2021). Becoming Human: A Theory of Ontogeny, Belknap Press of Harvard University Press.
28. The relationships between attraction of same-sex friend and relationship-maintenance motivation in the light of personal importance
29. Chidori, H., and Matsuzaki, G. (2012, January 22–24). Impression for the robot that the purpose of communication. Proceedings of the 59th Annual Conference of Japanese Society for the Science of Design, Sapporo, Japan. (In Japanese).
30. Advantages of virtual agents over clinical psychologists during comprehensive mental health interviews using a mixed methods design10.1016/j.chb.2018.03.045 ↗
31. Applying the ethics of AI: A systematic review of tools for developing and assessing AI-based systems10.1007/s10462-024-10740-3 ↗
32. Conversational agents in healthcare: A systematic review10.1093/jamia/ocy072 ↗
33. Rise of Machine Agency: A Framework for Studying the Psychology of Human–AI Interaction (HAII)10.1093/jcmc/zmz026 ↗
34. Temperament estimation of toddlers from child–robot interaction with explainable artificial intelligence10.1080/01691864.2021.1955001 ↗
35. Social support agents for older adults: Longitudinal affective computing in the home10.1007/s12193-014-0157-0 ↗
36. A systematic review on affective computing: Emotion models, databases, and recent advances10.1016/j.inffus.2022.03.009 ↗