journal article·2021-11-24Open access

Exploring Users’ Mental Models for Anthropomorphized Voice Assistants through Psychological Approaches

Dasom Park, Kiechan Namkung

Applied Sciences· Volume 11· Issue 23

Abstract

Various perspectives are being studied to increase the usability and persistence of voice assistants (VA) as the use is rapidly expanding to various domains. Particularly, many studies note that users personify VA. Systems designed to suit users differing mental models while using specific systems can provide a positive user experience, increasing usability and persistence. Therefore, we tried to structure the mental model of users using personified VA and proposed these results as an important factor to consider in personifying VA. To determine important factors to consider in personifying VA, this research structures the mental model of users using personified VA. Furthermore, we used two types of psychological approaches that were not applied in previous studies to analyze users’ mental models. Using two types of psychological approaches that were not applied in previous studies, this research analyzed users’ mental models. In Study 1, each user’s thinking process is derived through ZMET (Zaltman metaphor elicitation techniques) as a consensus map. Afterward, in Study 2, correlations between the key components analyzed in Study 1 are validated through RG (repertory grid technique). As a result, the research found that there are three different psychological structures. The first structure is of users who feel human-like empathy and warmth in the use of VA. Meanwhile, the second structure is of users who seek help with problem-solving. The last is the psychological structure of users who regarded anthropomorphic VA as just a machine. Users with this mental model expect the potential for development as a machine rather than the personification of VA. Ultimately, this research is meaningful in that it analyzes each user’s psychological mechanism for personified VA through a psychological approach and derives three new mental models in detail.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: AI in Service Interactions · Digital Marketing and Social Media · Social Robot Interaction and HRI

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Smart Experience Design, TED, Kookmin University, Seoul 02707, Korea

Industry Academic Cooperation Foundation, Kookmin University, Seoul 02707, Korea

References (100+)

Show source-provided references
1. (2020, August 30). Alexa Devices Maintain 70% Market Share in U.S. According to Survey. Available online: https://marketingland.com/alexa-devices-maintain-70-market-share-in-u-s-according-to-survey-265180.
2. Business-Insider (2020, July 24). Apple Says that 500 Million Customers Use Siri Business Insider. Available online: https://www.businessinsider.com/apple-says-siri-has-500-million-users-2018-1.
3. (2019, May 28). Global Smart Speaker Users 2019. Available online: https://www.emarketer.com/content/global-smart-speaker-users-2019.
4. Business-Insider (2020, May 13). Smart Speakers Are Becoming so Popular, More People will Use Them than Wearable Tech Products This Year. Business-Insider. Available online: https://www.businessinsider.com/more-us-adults-will-use-smart-speakers-than-wearables-in-2018-2018-5.
5. Hey Alexa… examine the variables influencing the use of artificial intelligent in-home voice assistants10.1016/j.chb.2019.05.009 ↗
6. Machines and mindlessness: Social responses to computers10.1111/0022-4537.00153 ↗
7. Epstein, R., Roberts, G., and Beber, G. (2009). Parsing the Turing Test: Philosophical and Methodological Issues in the Quest for the Thinking Computer, Springer. [1st ed.].10.1007/978-1-4020-6710-5 ↗
8. Feeling our way to machine minds: People’s emotions when perceiving mind in artificial intelligence10.1016/j.chb.2019.04.001 ↗
9. Are machines gender neutral? Gender-stereotypic responses to computers with voices10.1111/j.1559-1816.1997.tb00275.x ↗
10. Are people polite to computers? Responses to computer-based interviewing systems10.1111/j.1559-1816.1999.tb00142.x ↗
11. Initial expectations, interactions, and beyond with social robots10.1016/j.chb.2018.08.042 ↗
12. Schrills, T., and Franke, T. (2002). How to answer why-evaluating the explanations of ai through mental model analysis. arXiv.
13. Wahl, M., Krüger, J., and Frommer, J. (2016, January 17–22). Users’ Sense-Making of an Affective Intervention in Human-Computer Interaction. Proceedings of the International Conference on Human-Computer Interaction, Toronto, ON, Canada.10.1007/978-3-319-39513-5_7 ↗
14. Krüger, J., Wahl, M., and Frommer, J. (2016, January 17–22). Users’ relational ascriptions in user-companion interaction. Proceedings of the International Conference on Human-Computer Interaction, Toronto, ON, Canada.10.1007/978-3-319-39513-5_12 ↗
15. Anthropomorphism and the evolution of cognition
16. Anthropomorphism brings us closer: The mediating role of psychological distance in User–AI assistant interactions10.1016/j.chb.2021.106680 ↗
17. On seeing human: A three-factor theory of anthropomorphism10.1037/0033-295X.114.4.864 ↗
18. First impressions in human–Agent virtual encounters10.1145/2940325 ↗
19. Braun, M., Mainz, A., Chadowitz, R., Pfleging, B., and Alt, F. (2019, January 4–9). At your service: Designing voice assistant personalities to improve automotive user interfaces. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow Scotland, UK.10.1145/3290605.3300270 ↗
20. Integrating models of personality and emotions into lifelike characters10.1007/10720296_11 ↗
21. Jung, M.F. (2017, January 6–9). Affective Grounding in Human-Robot Interaction. Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (HRI ’17), Vienna, Austria.10.1145/2909824.3020224 ↗
22. Personality, coping, and coping effectiveness in an adult sample10.1111/j.1467-6494.1986.tb00401.x ↗
23. Keeping up impressions: Inferential rules for impression change across the Big Five10.1016/j.jesp.2006.04.006 ↗
24. Dimensions of brand personality10.1177/002224379703400304 ↗
25. Development of an instrument to measure web site personality10.1080/15252019.2006.10722124 ↗
26. Four ways five factors are not basic10.1016/0191-8869(92)90237-J ↗
27. The development of markers for the big-five factor structure10.1037/1040-3590.4.1.26 ↗
28. Humanizing voice assistant: The impact of voice assistant personality on consumers’ attitudes and behaviors10.1016/j.jretconser.2020.102283 ↗
29. Is that car smiling at me? Schema congruity as a basis for evaluating anthropomorphized products10.1086/518544 ↗
30. Damasio, A. (2019). The Strange Order of Things: Life, Feeling, and the Making of Cultures, Pantheon.
31. The influence of avatars on online consumer shopping behavior10.1509/jmkg.70.4.019 ↗
32. The internet-of-things: Review and research directions10.1016/j.ijresmar.2016.11.003 ↗
33. Correlates of social support receipt10.1037/0022-3514.53.1.71 ↗
34. The effect of emotional provider support on angry versus anxious consumers10.1016/j.ijresmar.2007.04.001 ↗
35. Coping: A multidimensional, hierarchical framework of responses to stressful consumption episodes10.1086/426612 ↗
36. Can messages make a difference? The association between e-mail messages and health outcomes in diabetes patients10.1111/j.1468-2958.2012.01437.x ↗
37. Seeking emotional support: The influence of affiliative need and partner warmth10.1037/0022-3514.60.1.112 ↗
38. Effects of Users Characteristics and Perceived Value on VPA Satisfaction10.21074/kjlcap.2019.20.1.31 ↗
39. Living with seal robots-its sociopsychological and physiological influences on the elderly at a care house10.1109/TRO.2007.906261 ↗
40. Effects of gender and relationship type on the response to artificial intelligence10.1089/cyber.2018.0581 ↗
41. Emotional support from a digital assistant in technology-mediated services: Effects on customer satisfaction and behavioral persistence10.1016/j.ijresmar.2020.06.004 ↗
42. A model of (often mixed) stereotype content: Competence and warmth respectively follow from perceived status and competition10.1037/0022-3514.82.6.878 ↗
43. Improving consumer satisfaction in green hotels: The roles of perceived warmth, perceived competence, and CSR motive10.1016/j.ijhm.2014.06.003 ↗
44. Trust and distrust definitions: One bite at a time10.1007/3-540-45547-7_3 ↗
45. Systematic review: Trust-building factors and implications for conversational agent design10.1080/10447318.2020.1807710 ↗
46. From glue to gasoline: How competition turns perspective takers unethical10.1177/0956797613482144 ↗
47. The mind in the machine: Anthropomorphism increases trust in an autonomous vehicle10.1016/j.jesp.2014.01.005 ↗
48. Establishing and maintaining long-term human-computer relationships10.1145/1067860.1067867 ↗
49. Broadbent, E., Kumar, V., Li, X., Sollers, J., Stafford, R.Q., MacDonald, B.A., and Wegner, D.M. (2013). Robots with display screens: A robot with a more human-like face display is perceived to have more mind and a better personality. PLoS ONE, 8.10.1371/journal.pone.0072589 ↗
50. Yam, K.C., Bigman, Y.E., Tang, P.M., Ilies, R., De Cremer, D., Soh, H., and Gray, K. (2020). Robots at work: People prefer—and forgive—service robots with perceived feelings. J. Appl. Psychol., Advance online publication.10.1037/apl0000834 ↗
51. Voices in and of the machine: Source orientation toward mobile virtual assistants10.1016/j.chb.2018.08.009 ↗
52. Cho, M., Lee, S., and Lee, K.P. (2019, January 23–28). Once a Kind Friend is Now a Thing: Understanding How Conversational Agents at Home are Forgotten. Proceedings of the 2019 on Designing Interactive Systems Conference (DIS ’19), San Diego, CA, USA.10.1145/3322276.3322332 ↗
53. Cowan, B.R., Pantidi, N., Coyle, D., Morrissey, K., Clarke, P., Al-Shehri, S., Earley, D., and Bandeira, N. (2017, January 4–7). "What can i help you with?": Infrequent users’ experiences of intelligent personal assistants. Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI’17), Vienna, Austria. Article 43.10.1145/3098279.3098539 ↗
54. Marchick, A. (2020, August 29). The 2017 Voice Report by Alpine (fka VoiceLabs). Available online: https://medium.com/@marchick/the-2017-voice-report-by-alpine-fka-voicelabs-24c5075a070f.
55. Rieh, S.Y., Yang, J.Y., Yakel, E., and Markey, K. (2010, January 18–21). Conceptualizing institutional repositories: Using co-discovery to uncover mental models. Proceedings of the third symposium on Information interaction in context, New Brunswick, NJ, USA.10.1145/1840784.1840809 ↗
56. Katz, E., Blumler, J.G., and Gurevitch, M. (1974). Utilization of Mass Communication by the Individual. The Uses of Mass Communications: Current Perspectives on Gratifications Research, Sage.
57. Using the uses and gratifications theory to understand gratifications sought through text messaging practices of male and female undergraduate students10.1016/j.chb.2012.06.024 ↗
58. My smart speaker is cool! perceived coolness, perceived values, and users’ attitude toward smart speakers10.1080/10447318.2020.1841404 ↗
59. Why people use Twitter: Social conformity and social value perspectives10.1108/OIR-11-2012-0210 ↗
60. Antecedents to the adoption of augmented reality smart glasses: A closer look at privacy risks10.1016/j.jbusres.2018.08.008 ↗
61. The effect of platform characteristics on the adoption of smart speakers: Empirical evidence in South Korea10.1016/j.tele.2018.07.013 ↗
62. Consumer acceptance of smart speakers: A mixed methods approach
63. Understanding user behavior of virtual personal assistant devices10.1007/s10257-018-0375-1 ↗
64. Should AI-Based, conversational digital assistants employ social- or task- oriented interaction style? A task-competency and reciprocity perspective for older adults10.1016/j.chb.2018.08.048 ↗
65. Reeves, B., and Nass, C. (1996). The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places, CSLI Publications and Cambridge University Press.
66. The effects of synthesized voice accents on user perceptions of robots10.1007/s12369-011-0100-4 ↗
67. Kwon, M., Jung, M.F., and Knepper, R.A. (2016, January 7–10). Human Expectations of Social Robots. Proceedings of the 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Christchurch, New Zealand.10.1109/HRI.2016.7451807 ↗
68. Hoy, M.B. (2019, January 20–24). Alexa, Siri, Cortana, and More: An Introduction to Voice Assistants. Interactive home healthcare system with integrated voice assistant. Proceedings of the 2019 42nd International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), Opatija, Croatia.
69. Keep your scanners peeled: Gaze behavior as a measure of automation trust during highly automated driving10.1177/0018720815625744 ↗
70. (2021, November 21). Cardiocube Voice-Based Ai Software. Available online: https://www.cardiocube.com/.
71. (2021, November 21). The Intelligent Healthcare Companion for the Home. Available online: https://www.pillohealth.com/.
72. Designing a spoken dialogue interface to an intelligent cognitive assistant for people with dementia10.1177/1460458215593329 ↗
73. Ondáš, S., Pleva, M., and Hládek, D. (2019, January 21–22). How chatbots can be involved in the education process. Proceedings of the 2019 17th International Conference on Emerging eLearning Technologies and Applications (ICETA), Starý Smokovec, Slovakia.10.1109/ICETA48886.2019.9040095 ↗
74. Voice assistants and artificial intelligence in education
75. Alonso, R., Concas, E., and Reforgiato Recupero, D. (2021). An abstraction layer exploiting voice assistant technologies for effective human—Robot interaction. Appl. Sci., 11.10.3390/app11199165 ↗
76. Speech-centric Multimodal Interaction for Easy-to-access Online Services—A Personal Life Assistant for the Elderly10.1016/j.procs.2014.02.043 ↗
77. Fernando, N., Tan, F.T.C., Vasa, R., Mouzaki, K., and Aitken, I. (2016, January 12–15). Examining digital assisted living: Towards a case study of smart homes for the elderly. Proceedings of the 24th European Conference on Information Systems ECIS, Istanbul, Turkey.
78. Design and evaluation of a smart home voice interface for the elderly: Acceptability and objection aspects10.1007/s00779-011-0470-5 ↗
79. Johnson-Laird, P.N. (2005). Mental models and thought. The Cambridge Handbook of Thinking and Reasoning, Cambridge University Press.
80. Mental models general introduction and review of their application to human-centred security
81. Craik, K.J.W. (1967). The Nature of Explanation, CUP Archive.
82. Zaltman, G. (2003). How Customers Think: Essential Insights into the Mind of the Market, Harvard Business School Press.
83. Cognitive science and science education10.1037/0003-066X.41.10.1123 ↗
84. A Framework for Building Intelligent Manufacturing Systems10.1109/5326.777077 ↗
85. How influential are mental models on interaction performance? Exploring the gap between users’ and designers’ mental models through a new quantitative method10.1155/2017/3683546 ↗
86. Norman, D.A. (1988). The Psychology of Everyday Things (The Design of Everyday Things), Basic Books.
87. Helander, M.G., Landauer, T.K., and Prabhu, P.V. (1997). Handbook of Human-Computer Interaction, North Holland/Elsevier. [2nd ed.].
88. Van der veer, G.C., and Melguizo, M.C.P. (2002). Mental models. The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, CRC Press.
89. Powers, A., and Kiesler, S. (2006, January 2–3). The advisor robot: Tracing people’s mental model from a robot’s physical attributes. Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction, Salt Lake City, UT, USA.10.1145/1121241.1121280 ↗
90. Nass, C., and Brave, S. (2005). Wired for Speech: How Voice Activates and Advances the Human–Computer Relationship, MIT Press.
91. Does computer-synthesized speech manifest personality? Experimental tests of recognition, similarity-attraction, and consistency-attraction
92. Kiesler, S. (2005, January 13–15). Fostering common ground in human-robot interaction. Proceedings of the IEEE International Workshop on Robots and Human Interactive Communication (RO-MAN 2005), Nashville, TN, USA.
93. Measuring mental models: Choosing the right tools for the job10.1002/hrdq.3920060303 ↗
94. Yamada, Y., Ishihara, K., and Yamaoka, T. (2011). A study on an usability measurement based on the mental model. International Conference on Universal Access in Human-Computer Interaction, Springer.10.1007/978-3-642-21672-5_19 ↗
95. The effects of metaphors on novice and expert learners’ performance and mental-model development10.1016/j.intcom.2005.10.008 ↗
96. Ziefle, M., and Bay, S. (2004, January 13). Mental models of a cellular phone menu. Comparing older and younger novice users. Proceedings of the International Conference on Mobile Human-Computer Interaction, Glasgow, UK.10.1007/978-3-540-28637-0_3 ↗
97. Brooks, J., and Brooks, M. (1999). In Search of Understanding: The Case for the Constructivist Classrooms, ASCD.
98. Constructivist Learning on the Web10.1002/ace.8808 ↗
99. Bannister, D. (1970). A brief introduction to personal construct psychology. Perspectives in Personal Construct Psychology, Academic Press.
100. Botella, L. Personal Construct Psychology and social constructionism. Proceedings of the XI International Congress on Personal Construct Psychology, Barcelona, Spain.