journal article·2025-03-07Open access

Behavioural Realism and Its Impact on Virtual Reality Social Interactions Involving Self-Disclosure

Alan Fraser, Ross Hollett, Craig Speelman, Shane L. Rogers

Applied Sciences· Volume 15· Issue 6

Abstract

This study investigates how the behavioural realism of avatars can enhance virtual reality (VR) social interactions involving self-disclosure. First, we review how factors such as trust, enjoyment, and nonverbal communication could be influenced by motion capture technology by enhancing behavioural realism. We also address a gap in the prior literature by comparing different motion capture systems and how these differences affect perceptions of realism, enjoyment, and eye contact. Specifically, this study compared two types of avatars: an iClone UNREAL avatar with full-body and facial motion capture and a Vive Sync avatar with limited motion capture for self-disclosure. Our participants rated the iClone UNREAL avatar higher for realism, enjoyment, and eye contact duration. However, as shown in our post-experiment survey, some participants reported that they preferred the avatar with less behavioural realism. We conclude that a higher level of behavioural realism achieved through more advanced motion capture can improve the experience of VR social interactions. We also conclude that despite the general advantages of higher motion capture, the simpler avatar was still acceptable and preferred by some participants. This has important implications for improving the accessibility of avatars for different contexts, such as therapy, where simpler avatars may be sufficient.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Virtual Reality Applications and Impacts · Media Influence and Health · Death Anxiety and Social Exclusion

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Arts and Humanities (Psychology), Edith Cowan University, Joondalup 6027, Australia

References (100+)

Show source-provided references
1. Speaking in Front of Cartoon Avatars: A Behavioral and Psychophysiological Study on How Audience Design Impacts on Public Speaking Anxiety in Virtual Environments10.1016/j.ijhcs.2023.103106 ↗
2. Hartbrich, J., Weidner, F., Kunert, C., Raake, A., Broll, W., and Arévalo Arboleda, S. (2023, January 3–6). Eye and Face Tracking in VR: Avatar Embodiment and Enfacement with Realistic and Cartoon Avatars. Proceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia, MUM ’23, Vienna, Austria.10.1145/3626705.3627793 ↗
3. Avatar-Mediated Experience in the Metaverse: The Impact of Avatar Realism on User-Avatar Relationship10.1016/j.jretconser.2023.103382 ↗
4. Virtual Influencer Marketing: Evaluating the Influence of Virtual Influencers’ Form Realism and Behavioral Realism on Consumer Ambivalence and Marketing Performance10.1016/j.jbusres.2024.114611 ↗
5. Kimmel, S., Jung, F., Matviienko, A., Heuten, W., and Boll, S. (2023, January 23–28). Let’s Face It: Influence of Facial Expressions on Social Presence in Collaborative Virtual Reality. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, CHI ’23, Hamburg, Germany.10.1145/3544548.3580707 ↗
6. Kullmann, P., Menzel, T., Botsch, M., and Latoschik, M.E. (2023). An Evaluation of Other-Avatar Facial Animation Methods for Social VR. Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, Association for Computing Machinery. CHI EA ’23.10.1145/3544549.3585617 ↗
7. The Effect of Avatar Self-Integration on Consumers’ Behavioral Intention in the Metaverse10.1080/10447318.2023.2279416 ↗
8. Comparing Technologies for Conveying Emotions through Realistic Avatars in Virtual Reality-Based Metaverse Experiences10.1002/cav.2188 ↗
9. Wei, S., Freeman, D., and Rovira, A. (2023). A Randomised Controlled Test of Emotional Attributes of a Virtual Coach within a Virtual Reality (VR) Mental Health Treatment. Sci. Rep., 13.10.1038/s41598-023-38499-7 ↗
10. Virtual Reality Environment-Based Collaborative Exploration of Fashion Design10.1080/15710882.2022.2162547 ↗
11. Brown, G., Hust, J., Büttner, S., and Prilla, M. (2022, January 4–7). The Impact of Varying Resolution and Motion Realism of Avatars in Augmented Reality-Supported, Virtually Co-Located Sales Consultations. Proceedings of the Mensch und Computer 2022, MuC ’22, Darmstadt, Germany.10.1145/3543758.3543772 ↗
12. Roth, D., Lugrin, J.-L., Galakhov, D., Hofmann, A., Bente, G., Latoschik, M.E., and Fuhrmann, A. (2016, January 19–23). Avatar Realism and Social Interaction Quality in Virtual Reality. Proceedings of the 2016 IEEE Virtual Reality (VR), Greenville, SC, USA.10.1109/VR.2016.7504761 ↗
13. Feelings of Presence and Perceived Social Support in Social Virtual Reality Platforms10.1016/j.chb.2022.107523 ↗
14. Fouts, M. (2023, November 15). Body Language in a Virtual World: How to Communicate Your Message Effectively. Forbes. Available online: https://www.forbes.com/sites/forbescoachescouncil/2021/09/30/body-language-in-a-virtual-world-how-to-communicate-your-message-effectively/.
15. Heath, A. (2023, November 15). Meta’s Social VR Platform Horizon Hits 300,000 Users. The Verge. Available online: https://www.theverge.com/2022/2/17/22939297/meta-social-vr-platform-horizon-300000-users.
16. Knobeloch, J. (2023, November 15). Social Interaction in the Metaverse: The Role of Nonverbal Signals in VRChat Culture|LinkedIn. Available online: https://www.linkedin.com/pulse/social-interaction-metaverse-role-nonverbal-signals-vrchat-knobeloch/.
17. Avatars with Faces of Real People: A Construction Method for Scientific Experiments in Virtual Reality10.3758/s13428-021-01676-5 ↗
18. Kokkinara, E., and McDonnell, R. (2015, January 16–18). Animation Realism Affects Perceived Character Appeal of a Self-Virtual Face. Proceedings of the 8th ACM SIGGRAPH Conference on Motion in Games, MIG ’15, Paris, France.10.1145/2822013.2822035 ↗
19. Ma, F., and Pan, X. (2022, January 12–16). Visual Fidelity Effects on Expressive Self-Avatar in Virtual Reality: First Impressions Matter. Proceedings of the 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Christchurch, New Zealand.10.1109/VR51125.2022.00023 ↗
20. Persa, G., Csapo, A., and Galambos, P. (2021, January 23–25). Avatars in 3D Virtual Reality: From Concrete to Abstract. Proceedings of the 12th IEEE International Conference on Cognitive Infocommunications, Online.
21. Does Avatar Design in Educational Games Promote a Positive Emotional Experience among Learners?10.1177/2042753021994337 ↗
22. Fraser, A.D., Branson, I., Hollett, R.C., Speelman, C.P., and Rogers, S.L. (2022). Expressiveness of Real-Time Motion Captured Avatars Influences Perceived Animation Realism and Perceived Quality of Social Interaction in Virtual Reality. Front. Virtual Real., 3.10.3389/frvir.2022.981400 ↗
23. Rogers, S.L., Broadbent, R., Brown, J., Fraser, A., and Speelman, C.P. (2022). Realistic Motion Avatars Are the Future for Social Interaction in Virtual Reality. Front. Virtual Real., 2.10.3389/frvir.2021.750729 ↗
24. The Influence of Avatar Representation on Interpersonal Communication in Virtual Social Environments10.1109/TVCG.2021.3067783 ↗
25. Freiwald, J.P., Schenke, J., Lehmann-Willenbrock, N., and Steinicke, F. (2021, January 5–8). Effects of Avatar Appearance and Locomotion on Co-Presence in Virtual Reality Collaborations. Proceedings of the Mensch und Computer 2021, MuC ’21, New York, NY, USA.10.1145/3473856.3473870 ↗
26. Effect of Behavioral Realism on Social Interactions inside Collaborative Virtual Environments10.1162/pres_a_00324 ↗
27. Kyrlitsias, C., and Michael-Grigoriou, D. (2022). Social Interaction with Agents and Avatars in Immersive Virtual Environments: A Survey. Front. Virtual Real., 2.10.3389/frvir.2021.786665 ↗
28. Cinemacraft: Exploring Fidelity Cues in Collaborative Virtual World Interactions10.1007/s10055-019-00382-0 ↗
29. Kruzic, C., Kruzic, D., Herrera, F., and Bailenson, J. (2020). Facial Expressions Contribute More than Body Movements to Conversational Outcomes in Avatar-Mediated Virtual Environments. Sci. Rep., 10.10.1038/s41598-020-76672-4 ↗
30. Have We Crossed the Uncanny Valley? Understanding Affinity, Trustworthiness, and Preference for Realistic Digital Humans in Immersive Environments
31. How Important Are Detailed Hand Motions for Communication for a Virtual Character Through the Lens of Charades?10.1145/3578575 ↗
32. Dodds, T.J., Mohler, B.J., and Bülthoff, H.H. (2011). Talk to the Virtual Hands: Self-Animated Avatars Improve Communication in Head-Mounted Display Virtual Environments. PLoS ONE, 6.10.1371/journal.pone.0025759 ↗
33. Gillies, M. (2018, January 28–30). Creating Virtual Characters. Proceedings of the 5th International Conference on Movement and Computing, Genoa, Italy. ACM International Conference Proceeding Series.10.1145/3212721.3212835 ↗
34. Why and How to Use Virtual Reality to Study Human Social Interaction: The Challenges of Exploring a New Research Landscape10.1111/bjop.12290 ↗
35. Thomas, S., Ferstl, Y., McDonnell, R., and Ennis, C. (2022, January 12–16). Investigating How Speech and Animation Realism Influence the Perceived Personality of Virtual Characters and Agents. Proceedings of the 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Christchurch, New Zealand.10.1109/VR51125.2022.00018 ↗
36. Point-Cloud Avatars to Improve Spatial Communication in Immersive Collaborative Virtual Environments10.1007/s00779-020-01431-1 ↗
37. Yoon, B., Kim, H., Lee, G.A., Billinghurst, M., and Woo, W. (2019, January 23–27). The Effect of Avatar Appearance on Social Presence in an Augmented Reality Remote Collaboration. Proceedings of the 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Osaka, Japan.10.1109/VR.2019.8797719 ↗
38. Do Realistic Avatars Make Virtual Reality Better? Examining Human-like Avatars for VR Social Interactions10.1016/j.chbah.2024.100082 ↗
39. Smith, H.J., and Neff, M. (2018, January 21–26). Communication Behavior in Embodied Virtual Reality. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI ’18, Montreal, QC, Canada.10.1145/3173574.3173863 ↗
40. Actors, Avatars and Agents: Potentials and Implications of Natural Face Technology for the Creation of Realistic Visual Presence
41. A Review of Eye Gaze in Virtual Agents, Social Robotics and HCI: Behaviour Generation, User Interaction and Perception10.1111/cgf.12603 ↗
42. Wu, Y., Wang, Y., Jung, S., Hoermann, S., and Lindeman, R.W. (2021). Using a Fully Expressive Avatar to Collaborate in Virtual Reality: Evaluation of Task Performance, Presence, and Attraction. Front. Virtual Real., 2.10.3389/frvir.2021.641296 ↗
43. The Effect of Avatar Facial Expressions on Trust Building in Social Virtual Reality10.1007/s00371-022-02700-1 ↗
44. Garau, M., Slater, M., Vinayagamoorthy, V., Brogni, A., Steed, A., and Sasse, M.A. (2003, January 5–10). The Impact of Avatar Realism and Eye Gaze Control on Perceived Quality of Communication in a Shared Immersive Virtual Environment. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’03, Ft. Lauderdale, FL, USA.10.1145/642700.642703 ↗
45. Rogers, S.L., Speelman, C.P., Guidetti, O., and Longmuir, M. (2018). Using Dual Eye Tracking to Uncover Personal Gaze Patterns during Social Interaction. Sci. Rep., 8.10.1038/s41598-018-22726-7 ↗
46. Render Me Real? Investigating the Effect of Render Style on the Perception of Animated Virtual Humans10.1145/2185520.2185587 ↗
47. Gaze Behavior to Faces during Dyadic Interaction
48. Testing the Interactivity Principle: Effects of Mediation, Propinquity, and Verbal and Nonverbal Modalities in Interpersonal Interaction10.1111/j.1460-2466.2002.tb02567.x ↗
49. Oh, S.Y., Bailenson, J., Krämer, N., and Li, B. (2016). Let the Avatar Brighten Your Smile: Effects of Enhancing Facial Expressions in Virtual Environments. PLoS ONE, 11.10.1371/journal.pone.0161794 ↗
50. Saberi, M., DiPaola, S., and Bernardet, U. (2021). Expressing Personality Through Non-Verbal Behaviour in Real-Time Interaction. Front. Psychol., 12.10.3389/fpsyg.2021.660895 ↗
51. Mathis, F., Vaniea, K., and Khamis, M. (2021, January 1–3). Observing Virtual Avatars: The Impact of Avatars’ Fidelity on Identifying Interactions. Proceedings of the 24th International Academic Mindtrek Conference, Virtual. Academic Mindtrek ’21.10.1145/3464327.3464329 ↗
52. How Does Virtual Reality Compare? The Effects of Avatar Appearance and Medium on Self-Disclosure10.1177/1071181322661123 ↗
53. Avatars for Teleconsultation: Effects of Avatar Embodiment Techniques on User Perception in 3D Asymmetric Telepresence10.1109/TVCG.2021.3106480 ↗
54. Roth, D., Kullmann, P., Bente, G., Gall, D., and Latoschik, M.E. (2018, January 16–20). Effects of Hybrid and Synthetic Social Gaze in Avatar-Mediated Interactions. Proceedings of the 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Munich, Germany.10.1109/ISMAR-Adjunct.2018.00044 ↗
55. Döllinger, N., Wolf, E., Mal, D., Wenninger, S., Botsch, M., Latoschik, M.E., and Wienrich, C. (2022). Resize Me! Exploring the User Experience of Embodied Realistic Modulatable Avatars for Body Image Intervention in Virtual Reality. Front. Virtual Real., 3.10.3389/frvir.2022.935449 ↗
56. Impact of Avatar Facial Anthropomorphism on Body Ownership, Attractiveness and Social Presence in Collaborative Tasks in Immersive Virtual Environments10.1016/j.cag.2021.08.011 ↗
57. Latoschik, M.E., Roth, D., Gall, D., Achenbach, J., Waltemate, T., and Botsch, M. (2017, January 8–10). The Effect of Avatar Realism in Immersive Social Virtual Realities. Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, VRST ’17, Gothenburg Sweden.10.1145/3139131.3139156 ↗
58. Zibrek, K., and McDonnell, R. (2019, January 28–30). Social Presence and Place Illusion Are Affected by Photorealism in Embodied VR. Proceedings of the 12th ACM SIGGRAPH Conference on Motion, Interaction and Games, MIG ’19, Newcastle upon Tyne, UK.10.1145/3359566.3360064 ↗
59. Naweed, A., Wardaszko, M., Leigh, E., and Meijer, S. (2018). Exploring Avatar Facial Fidelity and Emotional Expressions on Observer Perception of the Uncanny Valley. Intersections in Simulation and Gaming, Springer International Publishing. Lecture Notes in Computer Science.10.1007/978-3-319-78795-4 ↗
60. Sympathy for the Digital: Influence of Synthetic Voice on Affinity, Social Presence and Empathy for Photorealistic Virtual Humans10.1016/j.cag.2022.03.009 ↗
61. Higgins, D., Egan, D., Fribourg, R., Cowan, B., and McDonnell, R. (2021, January 16–17). Ascending from the Valley: Can State-of-the-Art Photorealism Avoid the Uncanny?. Proceedings of the ACM Symposium on Applied Perception 2021, SAP ’21, Online.10.1145/3474451.3476242 ↗
62. Kätsyri, J., Förger, K., Mäkäräinen, M., and Takala, T. (2015). A Review of Empirical Evidence on Different Uncanny Valley Hypotheses: Support for Perceptual Mismatch as One Road to the Valley of Eeriness. Front. Psychol., 6.10.3389/fpsyg.2015.00390 ↗
63. Too Real for Comfort? Uncanny Responses to Computer Generated Faces10.1016/j.chb.2008.12.026 ↗
64. Empirical Evaluation of the Uncanny Valley Hypothesis Fails to Confirm the Predicted Effect of Motion10.1016/j.cognition.2013.11.001 ↗
65. The Uncanny Valley: Effect of Realism on the Impression of Artificial Human Faces10.1162/pres.16.4.337 ↗
66. Hyde, J., Carter, E.J., Kiesler, S., and Hodgins, J.K. (2015, January 18–23). Using an Interactive Avatar’s Facial Expressiveness to Increase Persuasiveness and Socialness. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI ’15, New York, NY, USA.10.1145/2702123.2702465 ↗
67. The Impact of Avatar Realism and Anonymity on Effective Communication via Mobile Devices10.1016/j.chb.2012.10.010 ↗
68. Avatars and Computer-Mediated Communication: A Review of the Definitions, Uses, and Effects of Digital Representations10.12840/issn.2255-4165.2018.06.01.015 ↗
69. Developing a User-Informed Intervention Study of a Virtual Reality Therapy for Social Anxiety in Autistic Adolescents
70. Virtual Reality for Teletherapy: Avatars May Combine the Benefits of Face-to-Face Communication with the Anonymity of Online Text-Based Communication10.1089/cyber.2018.0247 ↗
71. Trauma Management Therapy with Virtual-Reality Augmented Exposure Therapy for Combat-Related PTSD: A Randomized Controlled Trial10.1016/j.janxdis.2017.08.005 ↗
72. Boeldt, D., McMahon, E., McFaul, M., and Greenleaf, W. (2019). Using Virtual Reality Exposure Therapy to Enhance Treatment of Anxiety Disorders: Identifying Areas of Clinical Adoption and Potential Obstacles. Front. Psychiatry, 10.10.3389/fpsyt.2019.00773 ↗
73. Virtual Reality Therapy in Mental Health10.1146/annurev-clinpsy-081219-115923 ↗
74. Examining the Potential of Virtual Reality to Deliver Remote Rehabilitation10.1016/j.chb.2019.106223 ↗
75. Kang, S.-H., and Gratch, J. (2015, January 10–15). The Effect of Avatar Realism of Virtual Humans on Self-Disclosure in Anonymous Social Interactions. Proceedings of the CHI ’10 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’10, Atlanta, GA, USA.
76. Seymour, M., Yuan, L., Dennis, A., and Riemer, K. (2019, January 8–11). Crossing the Uncanny Valley? Understanding Affinity, Trustworthiness, and Preference for More Realistic Virtual Humans in Immersive Environments. Proceedings of the Hawaii International Conference on System Sciences 2019, Maui, HI, USA.10.24251/HICSS.2019.213 ↗
77. Toward a More Robust Theory and Measure of Social Presence: Review and Suggested Criteria10.1162/105474603322761270 ↗
78. Lombard, M., Ditton, T.B., and Weinstein, L. (2009, January 11–13). Measuring Presence: The Temple Presence Inventory. Proceedings of the 12th Annual International Workshop on Presence, Los Angeles, CA, USA.
79. An Evaluation of Virtual Reality Role-Play Experiences for Helping-Profession Courses10.1177/0098628320983231 ↗
80. The Hyperpersonal Effect in Online Dating: Effects of Text-Based CMC vs. Videoconferencing before Meeting Face-to-Face10.1080/15213269.2019.1648217 ↗
81. Barbier, L., and Fointiat, V. (2020). To Be or Not Be Human-Like in Virtual World. Front. Comput. Sci., 2.10.3389/fcomp.2020.00015 ↗
82. Avatar-Driven Self-Disclosure: The Virtual Me Is the Actual Me10.1016/j.chb.2014.06.019 ↗
83. Meeting by Text or Video-Chat: Effects on Confidence and Performance10.1016/j.chbr.2021.100054 ↗
84. Aljaroodi, H.M., Adam, M.T.P., Chiong, R., and Teubner, T. (2019). Avatars and Embodied Agents in Experimental Information Systems Research: A Systematic Review and Conceptual Framework. Australas. J. Inf. Syst., 23.10.3127/ajis.v23i0.1841 ↗
85. The Effect of Behavioral Realism and Form Realism of Real-Time Avatar Faces on Verbal Disclosure, Nonverbal Disclosure, Emotion Recognition, and Copresence in Dyadic Interaction10.1162/pres.15.4.359 ↗
86. A Systematic Review on the Visualization of Avatars and Agents in AR & VR Displayed Using Head-Mounted Displays10.1109/TVCG.2023.3247072 ↗
87. Anvari, T., Park, K., and Kim, G. (2023). Upper Body Pose Estimation Using Deep Learning for a Virtual Reality Avatar. Appl. Sci., 13.10.3390/app13042460 ↗
88. Dai, P., Zhang, Y., Liu, T., Fan, Z., Du, T., Su, Z., Zheng, X., and Li, Z. (2024, January 16–22). HMD-Poser: On-Device Real-Time Human Motion Tracking from Scalable Sparse Observations. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.00089 ↗
89. Immersive Machine Learning for Social Attitude Detection in Virtual Reality Narrative Games10.1007/s10055-022-00644-4 ↗
90. Gamage, N.M., Ishtaweera, D., Weigel, M., and Withana, A. (2021, January 10–14). So Predictable! Continuous 3D Hand Trajectory Prediction in Virtual Reality. Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology, UIST ’21, Virtual Event.10.1145/3472749.3474753 ↗
91. Automated Classification of Virtual Reality User Motions Using a Motion Atlas and Machine Learning Approach10.1109/ACCESS.2024.3424930 ↗
92. Schwind, V., Halbhuber, D., Fehle, J., Sasse, J., Pfaffelhuber, A., Tögel, C., Dietz, J., and Henze, N. (2020, January 1–4). The Effects of Full-Body Avatar Movement Predictions in Virtual Reality Using Neural Networks. Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology, VRST ’20, Virtual Event.10.1145/3385956.3418941 ↗
93. Maloney, D., Zamanifard, S., and Freeman, G. (2020, January 1–4). Anonymity vs. Familiarity: Self-Disclosure and Privacy in Social Virtual Reality. Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology, Virtual Event.10.1145/3385956.3418967 ↗
94. Unobtrusive Tracking of Interpersonal Orienting and Distance Predicts the Subjective Quality of Social Interactions10.1098/rsos.191815 ↗
95. Beyond Being There: The Symbolic Role of Communication and Identification in Perceptions of Proximity to Geographically Dispersed Colleagues10.25300/MISQ/2014/38.4.13 ↗
96. Social Distance Increases Perceived Physical Distance10.1177/1948550617707017 ↗
97. Who Am I—And If so, Where? A Study on Personality in Virtual Realities10.4101/jvwr.v2i5.777 ↗
98. Virtual Reality-Assessment of Social Interactions and Prognosis in Depression10.1016/j.jad.2024.05.098 ↗
99. An Emerging Theory of Avatar Marketing10.1177/0022242921996646 ↗
100. Higgins, D., Zhan, Y., Cowan, B.R., and McDonnell, R. (2023, January 5–6). Investigating the Effect of Visual Realism on Empathic Responses to Emotionally Expressive Virtual Humans. Proceedings of the ACM Symposium on Applied Perception 2023, SAP ’23, Los Angeles, CA, USA.10.1145/3605495.3605799 ↗