Effects of Voice and Lighting Color on the Social Perception of Home Healthcare Robots
Source abstract
Abstract
The influence of matching between robots’ social cues on users’ social perceptions should be investigated systematically to better fit robots to their occupational roles. In this study, an experiment with 69 older and middle-aged participants was conducted to explore the effects of the voice and lighting color of a home healthcare robot on users’ social perception, which was measured by the Robotic Social Attributes Scale (RoSAS). The results indicated that voice and lighting color significantly affected social perceptions of the healthcare robot. Specifically, the adopted robot received high warmth ratings when it had an adult female voice or a child voice, whereas it received high competence ratings when it had an adult male voice. The robot received a high warmth rating and a high competence rating when warm and cool lighting were used, respectively, as visual feedback. Furthermore, a mismatch in the robot’s voice and lighting color was discovered to evoke feelings of discomfort. The findings of this study can be used as a reference to design robots with acceptable social perception and to expand the roles of social robots in the future.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Social Robot Interaction and HRI · Color perception and design · Olfactory and Sensory Function Studies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Fine Arts, Guangdong Polytechnic Normal University, Guangzhou 510665, China
Shien-Ming Wu School of Intelligent Engineering, South China University of Technology, Guangzhou 511442, China
Department of Creative Design, Dongguan City University, Dongguan 523419, China
Funding
Guangdong Polytechnic Normal University · Guangdong Social Science Association
References (80)
Show source-provided references
1. Dou, X., and Wu, C.-F. (2021). Are We Ready for “Them” Now? The Relationship Between Human and Humanoid Robots. Integrated Science, Springer.10.1007/978-3-030-65273-9_18 ↗
2. Can a social robot be too warm or too competent? Older Chinese adults’ perceptions of social robots and vulnerabilities10.1016/j.chb.2021.106942 ↗
3. The effect of facial features on facial anthropomorphic trustworthiness in social robots10.1016/j.apergo.2021.103420 ↗
4. The Role of Healthcare Robots for Older People at Home: A Review10.1007/s12369-014-0242-2 ↗
5. Does the Robot Have a Mind? Mind Perception and Attitudes towards Robots Predict Use of an Eldercare Robot10.1007/s12369-013-0186-y ↗
6. Controlling robots in the home: Factors that affect the performance of novice robot operators10.1016/j.apergo.2017.05.005 ↗
7. Nass, C., Steuer, J., and Tauber, E.R. (1994). Computers Are Social Actors: Conference Companion on Human Factors in Computing Systems-CHI’94, Association for Computing Machinery.10.1145/259963.260288 ↗
8. Beer, J.M., Liles, K.R., Wu, X., and Pakala, S. (2017). Affective Human—Robot Interaction. Emotions and Affect in Human Factors and Human-Computer Interaction, Academic Press.10.1016/B978-0-12-801851-4.00015-X ↗
9. My chatbot companion-a study of human-chatbot relationships10.1016/j.ijhcs.2021.102601 ↗
10. Stereotypes or golden rules? Exploring likable voice traits of social robots as active aging companions for tech-savvy baby boomers in Taiwan10.1016/j.chb.2018.02.025 ↗
11. The essential applications of educational robot: Requirement analysis from the perspectives of experts, researchers and instructors10.1016/j.compedu.2018.07.020 ↗
12. The Social Perception of Humanoid and Non-Humanoid Robots: Effects of Gendered and Machinelike Features10.1007/s12369-018-0502-7 ↗
13. When stereotypes meet robots: The double-edge sword of robot gender and personality in human-robot interaction10.1016/j.chb.2014.05.014 ↗
14. Aronson, E., Wilson, T.D., and Akert, R.M. (2010). Social Psychology, Prentice Hall. [7th ed.].
15. Paetzel, M., Perugia, G., and Castellano, G. (2020, January 23–26). The persistence of first impressions: The effect of repeated interactions on the perception of a social robot. Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, Cambridge, UK.10.1145/3319502.3374786 ↗
16. Socially interactive robots10.1016/S0921-8890(02)00371-8 ↗
17. Powers, A., and Kiesler, S. (2006, January 2–3). The advisor robot: Tracing people’s mental model from a robot’s physical attributes. Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-Robot Interaction, HRI 2006, Salt Lake City, UT, USA.10.1145/1121241.1121280 ↗
18. Powers, A., Kramer, A., Lim, S., Kuo, J., Lee, S.-L., and Kiesler, S. (2005, January 13–15). Eliciting information from people with a gendered humanoid robot. Proceedings of the IEEE International Workshop on Robot and Human Communication (ROMAN), Nashville, TN, USA.
19. Chidambaram, V., Chiang, Y.-H., and Mutlu, B. (2012, January 5–8). Designing persuasive robots: How robots might persuade people using vocal and nonverbal cues. Proceedings of the Seventh Annual ACM/IEEE International Conference on Human-Robot Interaction, Boston, MA, USA.10.1145/2157689.2157798 ↗
20. How Do Communication Cues Change Impressions of Human–Robot Touch Interaction?10.1007/s12369-017-0425-8 ↗
21. Morillo-Mendez, L., Schrooten, M.G.S., Loutfi, A., and Mozos, O.M. (2021). Age-related Differences in the Perception of Eye-gaze from a Social Robot. Soc. Robot., 350–361.10.1007/978-3-030-90525-5_30 ↗
22. Effects of different types of social robot voices on affective evaluations in different application fields10.1007/s12369-020-00654-9 ↗
23. Lee, S.-Y., Lee, G., Kim, S., and Lee, J. (2019). Expressing Personalities of Conversational Agents through Visual and Verbal Feedback. Electronics, 8.10.3390/electronics8070794 ↗
24. Understanding voice perception10.1111/j.2044-8295.2011.02041.x ↗
25. Making Social Robots More Attractive: The Effects of Voice Pitch, Humor and Empathy10.1007/s12369-012-0171-x ↗
26. Vocal types and stereotypes: Joint effects of vocal attractiveness and vocal maturity on person perception10.1007/BF00986878 ↗
27. Self-rated attractiveness predicts individual differences in women’s preferences for masculine men’s voices10.1016/j.paid.2008.05.013 ↗
28. Vocal communication of emotion: A review of research paradigms10.1016/S0167-6393(02)00084-5 ↗
29. Some variables affecting changes in interpersonal attraction10.1016/0022-1031(82)90059-2 ↗
30. What sounds beautiful is good: The vocal attractiveness stereotype10.1007/BF00990791 ↗
31. Baraka, K., Rosenthal, S., and Veloso, M. (2018). Enhancing human understanding of a mobile robot’s state and actions using expressive lights Enhancing Human Understanding of a Mobile Robot’s State and Actions using Expressive Lights. IEEE Explor. IEEE Org., 652–657.
32. Mobile Service Robot State Revealing Through Expressive Lights: Formalism, Design, and Evaluation10.1007/s12369-017-0431-x ↗
33. Baraka, K. (2016). Effective Non-Verbal Communication for Mobile Robots Using Expressive Lights. [Ph.D. Thesis, Carnegie Mellon University].
34. Designing LED lights for a robot to communicate gaze10.1080/01691864.2019.1600426 ↗
35. Kobayashi, K., Funakoshi, K., Yamada, S., Nakano, M., Komatsu, T., and Saito, Y. (August, January 31). Blinking light patterns as artificial subtle expressions in human-robot speech interaction. Proceedings of the 20th IEEE International Symposium on Robot and Human Interactive Communication, Atlanta, GA, USA.
36. Theory of mind, emotion recognition and social perception in individuals at clinical high risk for psychosis: Findings from the NAPLS-2 cohort10.1016/j.scog.2015.04.004 ↗
37. Ekman, P. (1982). What emotion categories or dimensions can observers judge from facial behavior?. Emot. Hum. Face, 39–55.
38. A dimensional approach to the circular ordering of the emotions10.1007/BF00998190 ↗
39. Plutchik, R. (1982). A Psychoevolutionary Theory of Emotions, Sage Publications.10.1177/053901882021004003 ↗
40. Terada, K., Yamauchi, A., and Ito, A. (2012, January 9–13). Artificial emotion expression for a robot by dynamic color change. Proceedings of the IEEE International Workshop on Robot and Human Communication (ROMAN), Paris, France.10.1109/ROMAN.2012.6343772 ↗
41. Why a ‘light’product package should not be light blue: Effects of package colour on perceived healthiness and attractiveness of sugar-and fat-reduced products10.1016/j.foodqual.2017.01.019 ↗
42. A note on adults’ color–emotion associations10.1080/00221325.1996.9914865 ↗
43. Universal dimensions of social cognition: Warmth and competence10.1016/j.tics.2006.11.005 ↗
44. Effect of Voice Type and Head-Light Color in Social Robots for Different Applications10.1007/s12369-021-00782-w ↗
45. Dou, X., Wu, C.-F., Wang, X., and Niu, J. (2020, January 19–24). User expectations of social robots in different applications: An online user study. Proceedings of the HCI International 2020-Late Breaking Papers: Multimodality and Intelligence, Copenhagen, Denmark.10.1007/978-3-030-60117-1_5 ↗
46. Dou, X. (2020). A Study on the Application Model of Social Robot’s Dialogue Style and Speech Parameters in Different Industries. [Ph.D. Thesis, Tatung University].
47. Assistive social robots in elderly care: A review10.4017/gt.2009.08.02.002.00 ↗
48. Wang, X., and Dou, X. (July, January 26). Designing a More Inclusive Healthcare Robot: The Relationship Between Healthcare Robot Tasks and User Capability. Proceedings of the HCI International 2022—Late Breaking Papers: HCI for Health, Well-being, Universal Access and Healthy Aging, Virtual Events.10.1007/978-3-031-17902-0_41 ↗
49. Walters, M.L., Syrdal, D.S., Koay, K.L., Dautenhahn, K., and Boekhorst, R.T. (2008, January 1–3). Human Approach Distances to a Mechanical-Looking Robot with Different Robot Voice Styles. Proceedings of the 17th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN, Munich, Germany.10.1109/ROMAN.2008.4600750 ↗
50. Niu, J., Wu, C.-F., Dou, X., and Lin, K.-C. (2022). Designing Gestures of Robots in Specific Fields for Different Perceived Personality Traits. Front. Psychol, 13.10.3389/fpsyg.2022.876972 ↗
51. Conversational computers10.1038/scientificamerican0605-64 ↗
52. What makes a female voice attractive?
53. Praat, a system for doing phonetics by computer
54. Laver, J., and John, L. (1994). Principles of Phonetics, Cambridge University Press.10.1017/CBO9781139166621 ↗
55. Anatomical and neuromuscular maturation of the speech mechanism: Evidence from acoustic studies10.1044/jshr.1903.421 ↗
56. Development of the prosodic features of infant vocalizing10.1044/jshr.1101.94 ↗
57. Kobayashi, K., Funakoshi, K., Yamada, S., Nakano, M., Komatsu, T., and Saito, Y. (2012, January 9–13). Impressions made by blinking light used to create artificial subtle expressions and by robot appearance in human-robot speech interaction. Proceedings of the IEEE International Workshop on Robot and Human Communication (ROMAN), Paris, France.10.1109/ROMAN.2012.6343756 ↗
58. Holtzschue, L. (2016). Understanding Color: An Introduction for Designers, John Wiley and Sons.
59. Environmental color, consumer feelings, and purchase likelihood10.1002/mar.4220090502 ↗
60. Color rendering properties of LED light sources10.1117/12.452574 ↗
61. Lee, H. (2019). Effects of Light-Emitting Diode (LED) Lighting Color on Human Emotion, Behavior, and Spatial Impression. [Ph.D. Thesis, Michigan State University].
62. Methodology & themes of human-robot interaction: A growing research field10.5772/5702 ↗
63. Do Robot Performance and Behavioral Style affect Human Trust?: A Multi-Method Approach
64. Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots10.1007/s12369-008-0001-3 ↗
65. Carpinella, C.M., Wyman, A.B., Perez, M.A., and Stroessner, S.J. (2017, January 6–9). The Robotic Social Attributes Scale (RoSAS). Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction-HRI, ‘17, Vienna, Austria.10.1145/2909824.3020208 ↗
66. Stereotyping based on voice in the presence of individuating information: Vocal femininity affects perceived competence but not warmth10.1177/0146167208326477 ↗
67. Niculescu, A., Dijk, B.V., Nijholt, A., and See, S.L. (December, January 29). The influence of voice pitch on the evaluation of a social robot receptionist. Proceedings of the 2011 International Conference on User Science and Engineering (i-USEr), Selangor, Malaysia.10.1109/iUSEr.2011.6150529 ↗
68. Color-emotion associations: Past experience and personal preference
69. Measuring the Uncanny Valley Effect: Refinements to Indices for Perceived Humanness, Attractiveness, and Eeriness10.1007/s12369-016-0380-9 ↗
70. Avoiding the uncanny valley: Robot appearance, personality and consistency of behavior in an attention-seeking home scenario for a robot companion10.1007/s10514-007-9058-3 ↗
71. Why some humanoid faces are perceived more positively than others: Effects of human-likeness and task10.1007/s12369-014-0269-4 ↗
72. Paetzel, M. (2016, January 12–16). The influence of appearance and interaction strategy of a social robot on the feeling of uncanniness in humans. Proceedings of the 18th ACM International Conference on Multimodal Interaction, Tokyo, Japan.10.1145/2993148.2997612 ↗
73. A mismatch in the human realism of face and voice produces an uncanny valley10.1068/i0415 ↗
74. Paetzel, M., Peters, C., Nyström, I., and Castellano, G. (2016, January 12–16). Effects of multimodal cues on children’s perception of uncanniness in a social robot. Proceedings of the 18th ACM International Conference on Multimodal Interaction, Tokyo, Japan.10.1145/2993148.2993157 ↗
75. The effects of luminance contrast, colour combinations, font, and search time on brand icon legibility10.1016/j.apergo.2017.05.015 ↗
76. Dou, X., Wu, C.F., Lin, K.-C., and Tseng, T.M. (2019, January 26–31). The Effects of Robot Voice and Gesture Types on the Perceived Robot Personalities. Proceedings of the International Conference on Human-Computer Interaction, Orlando, FL, USA.10.1007/978-3-030-22646-6_21 ↗
77. Siegel, M., Breazeal, C., and Norton, M.I. (2009, January 10–15). Persuasive robotics: The influence of robot gender on human behavior. Proceedings of the IEEE International Workshop on Intelligent Robots and Systems (IROS), St Louis, MO, USA.10.1109/IROS.2009.5354116 ↗
78. Predicting intention to work with social robots at anticipation stage: Assessing the role of behavioral desire and anticipated emotions10.1016/j.chb.2018.04.026 ↗
79. Singh, S., Chaudhary, D., Gupta, A.D., Lohani, B.P., Kushwaha, P.K., and Bibhu, V. (2022, January 27–29). Artificial Intelligence, Cognitive Robotics and Nature of Consciousness. Proceedings of the 3rd International Conference on Intelligent Engineering and Management (ICIEM), London, UK.10.1109/ICIEM54221.2022.9853081 ↗
80. Weller, C. (2017). Meet the first-ever robot citizen-a humanoid named Sophia that once said it would ‘destroy humans’. Bus. Insid., 27.