Telepresence Social Robotics towards Co-Presence: A Review
Source abstract
Abstract
Telepresence robots are becoming popular in social interactions involving health care, elderly assistance, guidance, or office meetings. There are two types of human psychological experiences to consider in robot-mediated interactions: (1) telepresence, in which a user develops a sense of being present near the remote interlocutor, and (2) co-presence, in which a user perceives the other person as being present locally with him or her. This work presents a literature review on developments supporting robotic social interactions, contributing to improving the sense of presence and co-presence via robot mediation. This survey aims to define social presence, co-presence, identify autonomous “user-adaptive systems” for social robots, and propose a taxonomy for “co-presence” mechanisms. It presents an overview of social robotics systems, applications areas, and technical methods and provides directions for telepresence and co-presence robot design given the actual and future challenges. Finally, we suggest evaluation guidelines for these systems, having as reference face-to-face interaction.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Virtual Reality Applications and Impacts · Social Robot Interaction and HRI · Evacuation and Crowd Dynamics
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Ci2—Smart Cities Research Center, Polytechnic Institute of Tomar, 2300-313 Tomar, Portugal
Institute of Systems and Robotics, University of Coimbra, 3030-290 Coimbra, Portugal
Khalifa University Center for Autonomous Robotic Systems (KUCARS), Khalifa University of Science and Technology (KU), Abu Dhabi 127788, United Arab Emirates
Funding
European Regional Development Fund (ERDF)
References (100+)
Show source-provided references
1. A review of recent research in social robotics10.1016/j.copsyc.2020.01.003 ↗
2. Nocentini, O., Fiorini, L., Acerbi, G., Sorrentino, A., Mancioppi, G., and Cavallo, F. (2019). A Survey of Behavioral Models for Social Robots. Robotics, 8.10.20944/preprints201905.0251.v1 ↗
3. Design Challenges and Guidelines for Social Interaction Using Mobile Telepresence Robots10.1177/1557234X13502462 ↗
4. Alabdulkareem, A., Alhakbani, N., and Al-Nafjan, A. (2022). A Systematic Review of Research on Robot-Assisted Therapy for Children with Autism. Sensors, 22.10.3390/s22030944 ↗
5. Break the ice: A survey on socially aware engagement for human–robot first encounters10.1007/s12369-020-00720-2 ↗
6. Isabet, B., Pino, M., Lewis, M., Benveniste, S., and Rigaud, A.S. (2021). Social Telepresence Robots: A Narrative Review of Experiments Involving Older Adults before and during the COVID-19 Pandemic. Int. J. Environ. Res. Public Health, 18.10.3390/ijerph18073597 ↗
7. IEEE (2022, April 05). Robots: Your Guide to the World of Robotics. Available online: https://robots.ieee.org/.
8. User-adaptive interaction in social robots: A survey focusing on non-physical interaction10.1007/s12369-018-0485-4 ↗
9. Hellou, M., Gasteiger, N., Lim, J.Y., Jang, M., and Ahn, H.S. (2021). Personalization and Localization in Human-Robot Interaction: A Review of Technical Methods. Robotics, 10.10.3390/robotics10040120 ↗
10. IJsselsteijn, W. (2003). Presence in the past: What can we learn from media history?. Being There: Concepts, Effects and Measurements of User Presence in Synthetic Environments. Emerging Communication: Studies in New Technologies and Practices in Communication, IOS Press.
11. Telepresence
12. Short, J., Williams, E., and Christie, B. (1976). The Social Psychology of Telecommunications, John Wiley & Son.
13. Toward a more robust theory and measure of social presence: Review and suggested criteria10.1162/105474603322761270 ↗
14. Defining Virtual Reality: Dimensions Determining Telepresence10.1111/j.1460-2466.1992.tb00812.x ↗
15. Biocca, F. (1997, January 25–28). The Cyborg’s Dilemma: Embodiment in Virtual Environments. Proceedings of the Second International Conference on Cognitive Technology Humanizing the Information Age, Aizu-Wakamatsu, Japan.
16. Musings on telepresence and virtual presence10.1162/pres.1992.1.1.120 ↗
17. The effect of the agency and anthropomorphism on users’ sense of telepresence, copresence, and social presence in virtual environments10.1162/105474603322761289 ↗
18. Toward a taxonomy of copresence10.1162/105474603322761261 ↗
19. Lombard, M., Biocca, F., Freeman, J., IJsselsteijn, W., and Schaevitz, R. (2015). Immersed in Media: Telepresence Theory, Measurement & Technology, Springer International Publishing.10.1007/978-3-319-10190-3 ↗
20. Paulos, E., and Canny, J. (1998, January 18–23). PRoP: Personal roving presence. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Los Angeles, CA, USA.10.1145/274644.274686 ↗
21. Ubiquitous Tele-embodiment: Applications and Implications10.1006/ijhc.1996.0120 ↗
22. Social tele-embodiment: Understanding presence10.1023/A:1011264330469 ↗
23. Transcending the self in immersive virtual reality10.1109/MC.2014.198 ↗
24. Full-body illusions and minimal phenomenal selfhood10.1016/j.tics.2008.10.003 ↗
25. The benefit of being physically present: A survey of experimental works comparing copresent robots, telepresent robots and virtual agents10.1016/j.ijhcs.2015.01.001 ↗
26. Goffman, E. (1963). Behavior in Public Places, Free Press. A Free Press paperback.
27. Who is this?: Identity and presence in robot-mediated communication10.1016/j.cogsys.2016.07.006 ↗
28. Avatars and computer-mediated communication: A review of the definitions, uses, and effects of digital representations10.12840/issn.2255-4165.2018.06.01.015 ↗
29. A systematic review of social presence: Definition, antecedents, and implications10.3389/frobt.2018.00114 ↗
30. Copresence with virtual humans in mixed reality: The impact of contextual responsiveness on social perceptions
31. A Brief Survey of Telerobotic Time Delay Mitigation
32. Assuncao, G., Patrao, B., Castelo-Branco, M., and Menezes, P. (2022). An Overview of Emotion in Artificial Intelligence. IEEE Trans. Artif. Intell.10.1109/TAI.2022.3159614 ↗
33. Cummings, J.J., and Wertz, B. (2018, January 3–6). Technological predictors of social presence: A foundation for a meta-analytic review and empirical concept explication. Proceedings of the 10th Annual International Workshop on Presence, Prague, Czech Republic.
34. Virtual reality in neuroscience research and therapy10.1038/nrn3122 ↗
35. Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments10.1098/rstb.2009.0138 ↗
36. Enhancing Our Lives with Immersive Virtual Reality
37. Slater, M., Spanlang, B., Sanchez-Vives, M.V., and Blanke, O. (2010). First Person Experience of Body Transfer in Virtual Reality. PLoS ONE, 5.10.1371/journal.pone.0010564 ↗
38. Behavioral, neural, and computational principles of bodily self-consciousness10.1016/j.neuron.2015.09.029 ↗
39. At the Heart of It All: The Concept of Presence
40. Saari, T., Laarni, J., Ravaja, N., Kallinen, K., and Turpeinen, M. (2004, January 13–14). Virtual Ba and Presence in Facilitating Learning from Technology Mediated Organizational Information Flows. Proceedings of the Annual International Workshop on Presence, Valencia, Spain.
41. Defining and measuring social presence: Contribution to the networked minds theory and measure
42. Organizational information requirements, media richness and structural design10.1287/mnsc.32.5.554 ↗
43. How immersive is enough? A meta-analysis of the effect of immersive technology on user presence10.1080/15213269.2015.1015740 ↗
44. Biocca, F., Harms, C., and Gregg, J. (2001, January 21–23). The networked minds measure of social presence: Pilot test of the factor structure and concurrent validity. Proceedings of the 4th Annual International Workshop on presence, Philadelphia, PA, USA.
45. The role of social presence in opinion expression during FtF and CMC discussions10.1080/08824096.2011.639913 ↗
46. Academic self-concept and social presence in face-to-face and online learning: Perceptions and effects on students’ learning achievement and satisfaction across environments10.1016/j.compedu.2013.07.002 ↗
47. Evaluation of the efficacy of collaborative learning in face-to-face and computer-supported university contexts10.1016/j.chb.2005.03.001 ↗
48. Social presence in a home tele-application10.1089/109493101300117974 ↗
49. de Greef, H. (2014, January 17–19). Video communication best for female friends?. Proceedings of the ISPR 2014: 15th International Workshop on Presence (PRESENCE 2014), Vienna, Austria.
50. Avatar-mediated networking: Increasing social presence and interpersonal trust in net-based collaborations10.1111/j.1468-2958.2008.00322.x ↗
51. Blascovich, J. (2002). Social Influence within Immersive Virtual Environments, Springer.10.1037/e705412011-034 ↗
52. Effects of collaborative online shopping on shopping experience through social and relational perspectives10.1016/j.im.2013.02.003 ↗
53. Is a profile worth a thousand words? How online support-seeker’s profile features may influence the quality of received support messages10.1177/0093650213510942 ↗
54. “It doesn’t matter what you are!” Explaining social effects of agents and avatars10.1016/j.chb.2010.06.012 ↗
55. Pan, X., Gillies, M., and Slater, M. (2008, January 16–18). The impact of avatar blushing on the duration of interaction between a real and virtual person. Proceedings of the Presence 2008: The 11th Annual International Workshop on Presence, Padova, Italy.
56. The impact of avatar realism and anonymity on effective communication via mobile devices10.1016/j.chb.2012.10.010 ↗
57. Equilibrium theory revisited: Mutual gaze and personal space in virtual environments10.1162/105474601753272844 ↗
58. Immersive virtual environment technology as a methodological tool for social psychology10.1207/S15327965PLI1302_01 ↗
59. Blascovich, J., and Bailenson, J. (2011). Infinite Reality: Avatars, Eternal Life, New Worlds, and the Dawn of the Virtual Revolution, William Morrow & Co.
60. Cockton, G., and Korhonen, P. (2003, January 5–10). The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment. Proceedings of the 2003 Conference on Human Factors in Computing Systems, CHI 2003, Ft. Lauderdale, FL, USA.
61. The independent and interactive effects of embodied-agent appearance and behavior on self-report, cognitive, and behavioral markers of copresence in immersive virtual environments10.1162/105474605774785235 ↗
62. Jo, D., Kim, K.H., and Kim, G.J. (2017, January 22–24). Effects of avatar and background types on users’ co-presence and trust for mixed reality-based teleconference systems. Proceedings of the 30th Conference on Computer Animation and Social Agents, Seoul, Korea.
63. An experimental study of embodied interaction and human perception of social presence for interactive robots in public settings10.1109/TCDS.2017.2787196 ↗
64. Perret, J., and Vander Poorten, E. (2018, January 25–27). Touching Virtual Reality: A Review of Haptic Gloves. Proceedings of the ACTUATOR 2018: 16th International Conference on New Actuators, Bremen, Germany.
65. Fernando, C., Furukawa, M., Kurogi, T., Kamuro, S., Sato, K., Minamizawa, K., and Tachi, S. (2012, January 7–12). Design of TELESAR V for transferring bodily consciousness in telexistence. Proceedings of the 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, Vilamoura, Algarve, Portugal.10.1109/IROS.2012.6385814 ↗
66. Fisch, A., Mavroidis, C., Melli-Huber, J., and Bar-Cohen, Y. (2003). Haptic devices for virtual reality, telepresence, and human-assistive robotics. Biologically Inspired Intelligent Robots, SPIE Digital Library.10.1117/3.2068093.ch4 ↗
67. Prasad, V., Stock-Homburg, R., and Peters, J. (2021). Human-robot handshaking: A review. arXiv.10.1007/978-3-030-62056-1_40 ↗
68. Bevan, C., and Fraser, D.S. (2015, January 2–5). Shaking hands and cooperation in tele-present human-robot negotiation. Proceedings of the 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Portland, OR, USA.10.1145/2696454.2696490 ↗
69. Jones, M., Palanque, P.A., Schmidt, A., and Grossman, T. (May, January 26). Remote handshaking: Touch enhances video-mediated social telepresence. Proceedings of the CHI Conference on Human Factors in Computing Systems, CHI’14, Toronto, ON, Canada.
70. Mostofa, N., Avendano, I., McMahan, R.P., Conner, N.E., Anderson, M., and Welch, G.F. (2021, January 4–8). Tactile Telepresence for Isolated Patients. Proceedings of the 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Bari, Italy.10.1109/ISMAR-Adjunct54149.2021.00078 ↗
71. Carvalho, M., Avelino, J., Bernardino, A., Ventura, R.M.M., and Moreno, P. (October, January 27). Human-Robot greeting: Tracking human greeting mental states and acting accordingly. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2021, Prague, Czech Republic.10.1109/IROS51168.2021.9635894 ↗
72. Kendon, A. (1990). Conducting Interaction: Patterns of Behavior in Focused Encounters, Cambridge University Press.
73. Colledanchise, M., and Ögren, P. (2018). Behavior Trees in Robotics and AI: An Introduction, CRC Press.10.1201/9780429489105 ↗
74. TELESAR VI: Telexistence Surrogate Anthropomorphic Robot VI10.1142/S021984362050019X ↗
75. Almeida, L., Menezes, P., Seneviratne, L., and Dias, J. (2011, January 7–9). Incremental 3d body reconstruction framework for robotic telepresence applications. Proceedings of the Robo 2011: The 2nd IASTED International Conference on Robotics, Pittsburgh, PA, USA.10.2316/P.2011.752-068 ↗
76. Almeida, L., Menezes, P., and Dias, J. (2013). Augmented reality framework for the socialization between elderly people. Handbook of Research on ICTs for Human-Centered Healthcare and Social Care Services, IGI Global.10.4018/978-1-4666-3986-7.ch023 ↗
77. Plüss, C., Ranieri, N., Bazin, J.C., Martin, T., Laffont, P.Y., Popa, T., and Gross, M. (2016, January 23–25). An immersive bidirectional system for life-size 3d communication. Proceedings of the CASA ’16: 29th International Conference on Computer Animation and Social Agents, Geneva, Switzerland.10.1145/2915926.2915931 ↗
78. Dicke, C., Aaltonen, V., Rämö, A., and Vilermo, M. (2010, January 6–10). Talk to me: The influence of audio quality on the perception of social presence. Proceedings of the HCI 2010 24, University of Abertay, Dundee, UK.10.14236/ewic/HCI2010.36 ↗
79. Lanillos, P., Ferreira, J.F., and Dias, J. (October, January 28). Designing an artificial attention system for social robots. Proceedings of the 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.10.1109/IROS.2015.7353967 ↗
80. Almeida, L., Menezes, P., and Dias, J. (2020). Interface Transparency Issues in Teleoperation. Appl. Sci., 10.10.3390/app10186232 ↗
81. Kim, D., and Jo, D. (2022). Effects on Co-Presence of a Virtual Human: A Comparison of Display and Interaction Types. Electronics, 11.10.3390/electronics11030367 ↗
82. Appel, J., von der Pütten, A., Krämer, N.C., and Gratch, J. (2012). Does Humanity Matter? Analyzing the Importance of Social Cues and Perceived Agency of a Computer System for the Emergence of Social Reactions during Human-Computer Interaction. Adv. Hum.-Comp. Int., 2012.10.1155/2012/324694 ↗
83. Toward a Context-Aware Human–Robot Interaction Framework Based on Cognitive Development10.1109/TSMC.2018.2833384 ↗
84. Promotion of active ageing through interactive artificial agents in a smart environment10.1007/s42452-021-04567-8 ↗
85. Can online buddies and bandwagon cues enhance user participation in online health communities?10.1016/j.chb.2014.04.039 ↗
86. How social context cues in online support-seeking influence self-disclosure in support provision10.1080/01463373.2015.1078389 ↗
87. Blowing in the wind: Increasing social presence with a virtual human via environmental airflow interaction in mixed reality10.1016/j.cag.2019.06.006 ↗
88. Gender Differences in E-Learning: Communication, Social Presence, and Learning Outcomes10.4018/joeuc.2011010105 ↗
89. Exploring the effects of students’ social networking experience on social presence and perceptions of using SNSs for educational purposes10.1016/j.iheduc.2015.12.001 ↗
90. Parasocial Interaction with an Avatar in Second Life: A Typology of the Self and an Empirical Test of the Mediating Role of Social Presence10.1162/PRES_a_00001 ↗
91. A Natural Interface for Remote Operation of Underwater Robots10.1109/MCG.2015.118 ↗
92. Almeida, L., Menezes, P., and Dias, J. (2017, January 6–8). Improving robot teleoperation experience via immersive interfaces. Proceedings of the 2017 4th Experiment@International Conference (exp.at’17), Faro, Algarve, Portugal.10.1109/EXPAT.2017.7984414 ↗
93. Effects of haptic feedback, stereoscopy, and image resolution on performance and presence in remote navigation10.1016/j.ijhcs.2008.05.001 ↗
94. The effects of actual human size display and stereoscopic presentation on users’ sense of being together with and of psychological immersion in a virtual character10.1089/cyber.2013.0455 ↗
95. A Bayesian framework for active artificial perception10.1109/TSMCB.2012.2214477 ↗
96. Enhanced personal autostereoscopic telepresence system using commodity depth cameras10.1016/j.cag.2012.04.011 ↗
97. Social-psychological origins of feelings of presence: Creating social presence with machine-generated voices10.1207/S1532785XMEP0701_2 ↗
98. Location and modality effects in online dating: Rich modality profile and location-based information cues increase social presence, while moderating the impact of uncertainty reduction strategy10.1089/cyber.2017.0027 ↗
99. Caregiving role in human–robot interaction: A study of the mediating effects of perceived benefit and social presence10.1016/j.chb.2013.02.009 ↗
100. telepresencerobots.com (2022, April 05). Telepresence Robots Shop. Available online: https://telepresencerobots.com/robots/orbis-robotics-teleporter/.