Sensorial Feedback Contribution to the Sense of Embodiment in Brain–Machine Interfaces: A Systematic Review
Source abstract
Abstract
The sense of embodiment (SoE) is an essential element of human perception that allows individuals to control and perceive the movements of their body parts. Brain–machine interface (BMI) technology can induce SoE in real time, and adding sensory feedback through various modalities has been shown to improve BMI control and elicit SoEe. In this study, we conducted a systematic review to study BMI performance in studies that integrated SoE variables and analyzed the contribution of single or multimodal sensory stimulation. Out of 493 results, only 20 studies analyzed the SoE of humans using BMIs. Analysis of these articles revealed that 40% of the studies relating BMIs with sensory stimulation and SoE primarily focused on manipulating visual stimuli, particularly in terms of coherence (i.e., synchronous vs. asynchronous stimuli) and realism (i.e., humanoid or robotic appearance). However, no study has analyzed the independent contributions of different sensory modalities to SoE and BMI performance. These results suggest that providing a detailed description of the outcomes resulting from independent and combined effects of different sensory modalities on the experience of SoE during BMI control may be relevant for the design of neurorehabilitation programs.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: EEG and Brain-Computer Interfaces · Neural and Behavioral Psychology Studies · Tactile and Sensory Interactions
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Health Sciences and Nursing (FCSE), Center for Interdisciplinary Research in Health (CIIS), Universidade Católica Portuguesa, 1649-023 Lisboa, Portugal
Escola Superior de Saúde Atlântica, 2730-036 Barcarena, Portugal
Department of Medical Sciences, Institute of Biomedicine (iBiMED), Universidade de Aveiro, 3810-193 Aveiro, Portugal
Funding
CIIS · iBiMED
References (70)
Show source-provided references
1. Full-Body Illusions and Minimal Phenomenal Selfhood10.1016/j.tics.2008.10.003 ↗
2. A Self for the Body10.1111/j.1467-9973.2011.01688.x ↗
3. The Sense of Embodiment in Virtual Reality10.1162/PRES_a_00124 ↗
4. Presence, Explicated10.1111/j.1468-2885.2004.tb00302.x ↗
5. What Is Embodiment? A Psychometric Approach10.1016/j.cognition.2007.12.004 ↗
6. Body in the Interactive Game: How Interface Embodiment Affects Physical Activity and Health Behavior Change10.1016/j.chb.2014.03.067 ↗
7. Adjusting to Bodily Change Following Stoma Formation: A Phenomenological Study10.3109/09638288.2015.1107768 ↗
8. Body Image Distortions Following Spinal Cord Injury10.1136/jnnp-2012-304001 ↗
9. Body Perception Disturbance: A Contribution to Pain in Complex Regional Pain Syndrome (CRPS)10.1016/j.pain.2007.03.013 ↗
10. Role of Distorted Body Image in Pain10.1007/s11926-007-0079-x ↗
11. Patterns of Cortical Reorganization Parallel Impaired Tactile Discrimination and Pain Intensity in Complex Regional Pain Syndrome10.1016/j.neuroimage.2006.03.045 ↗
12. Humanlike Robot Hands Controlled by Brain Activity Arouse Illusion of Ownership in Operators10.1038/srep02396 ↗
13. Juliano, J.M., Spicer, R.P., Vourvopoulos, A., Lefebvre, S., Jann, K., Ard, T., Santarnecchi, E., Krum, D.M., and Liew, S.L. (2020). Embodiment Is Related to Better Performance on a Brain–Computer Interface in Immersive Virtual Reality: A Pilot Study. Sensors, 20.10.3390/s20041204 ↗
14. Agency and Responsibility over Virtual Movements Controlled through Different Paradigms of Brain−computer Interface10.1113/JP278167 ↗
15. Embodiment Comfort Levels During Motor Imagery Training Combined with Immersive Virtual Reality in a Spinal Cord Injury Patient10.3389/fnhum.2022.909112 ↗
16. Inducing a Virtual Hand Ownership Illusion through a Brain-Computer Interface10.1097/WNR.0b013e32832a0a2a ↗
17. Embodied VR Environment Facilitates Motor Imagery Brain–Computer Interface Training10.1016/j.cag.2018.05.024 ↗
18. The Role of Audio-Visual Feedback in a Thought-Based Control of a Humanoid Robot: A BCI Study in Healthy and Spinal Cord Injured People10.1109/TNSRE.2016.2597863 ↗
19. Evans, N., Gale, S., Schurger, A., and Blanke, O. (2015). Visual Feedback Dominates the Sense of Agency for Brain-Machine Actions. PLoS ONE, 10.10.1371/journal.pone.0130019 ↗
20. “Mine Works Better”: Examining the Influence of Embodiment in Virtual Reality on the Sense of Agency During a Binary Motor Imagery Task With a Brain-Computer Interface10.3389/fpsyg.2021.806424 ↗
21. Avatar Embodiment. Towards a Standardized Questionnaire10.3389/frobt.2018.00074 ↗
22. Schwind, V., Knierim, P., Haas, N., and Henze, N. (2019, January 4–9). Using Presence Questionnaires in Virtual Reality. Proceedings of the Conference on Human Factors in Computing Systems—Proceedings, Association for Computing Machinery, Glasgow, Scotland.10.1145/3290605.3300590 ↗
23. Franco, M.G. (2023, February 19). Neurophysiological Signatures of the Body Representation in the Brain Using Immersive Virtual Reality. Available online: http://hdl.handle.net/10803/359383.
24. Alchalabi, B., Faubert, J., and Labbe, D.R. (2019, January 23–27). EEG Can Be Used to Measure Embodiment When Controlling a Walking Self-Avatar. Proceedings of the 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Osaka, Japan.10.1109/VR.2019.8798263 ↗
25. Projecting Sensations to External Objects: Evidence from Skin Conductance Response10.1098/rspb.2003.2364 ↗
26. Upper Limb Amputees Can Be Induced to Experience a Rubber Hand as Their Own10.1093/brain/awn297 ↗
27. Tsuji, T., Yamakawa, H., Yamashita, A., Takakusaki, K., Maeda, T., Kato, M., Oka, H., and Asama, H. (2013, January 7–9). Analysis of Electromyography and Skin Conductance Response During Rubber Hand Illusion. Proceedings of the 2013 IEEE Workshop on Advanced Robotics and its Social Impacts, Tokyo, Japan.10.1109/ARSO.2013.6705511 ↗
28. Feeling Numb: Temperature, but Not Thermal Pain, Modulates Feeling of Body Ownership10.1016/j.neuropsychologia.2011.02.039 ↗
29. The Relationship between Virtual Body Ownership and Temperature Sensitivity10.1098/rsif.2013.0300 ↗
30. The senses of agency and ownership: A review10.3389/fpsyg.2018.00535 ↗
31. Measuring presence in virtual environments: A presence questionnaire10.1162/105474698565686 ↗
32. EEG-based communication: Improved accuracy by response verification10.1109/86.712231 ↗
33. Sanchez-Vives, M.V., Spanlang, B., Frisoli, A., Bergamasco, M., and Slater, M. (2010). Virtual hand illusion induced by visuomotor correlations. PLoS ONE, 5.10.1371/journal.pone.0010381 ↗
34. A method for generating an illusion of backwards time travel using immersive virtual reality—An exploratory study10.3389/fpsyg.2014.00943 ↗
35. Peck, T.C., and Gonzalez-Franco, M. (2021). Avatar embodiment. A standardized questionnaire. Front. Virtual Real., 1.10.3389/frvir.2020.575943 ↗
36. Caspar, E.A., de Beir, A., Lauwers, G., Cleeremans, A., and Vanderborght, B. (2021). How Using Brain-Machine Interfaces Influences the Human Sense of Agency. PLoS ONE, 16.10.1371/journal.pone.0245191 ↗
37. Sense of Agency for Intracortical Brain-Machine Interfaces10.1038/s41562-021-01233-2 ↗
38. Pais-Vieira, C., Gaspar, P., Matos, D., Gago, M., Azevedo, M.J., Poleri, T., Perrotta, A., and Paisvieira, M. (2022, January 21–23). Multimodal Visual, Auditory, Thermal, and Tactile Feedback During Brain-Machine Interface Use by a Spinal Cord Injury Patient. Proceedings of the Human Interaction & Emerging Technologies (IHIET-AI 2022): Artificial Intelligence & Future Applications, Nice, France.10.54941/ahfe100912 ↗
39. Brain Computer Interface Advancement in Neurosciences: Applications and Issues10.1016/j.inat.2020.100694 ↗
40. Brain-Machine Interfaces: From Basic Science to Neuroprostheses and Neurorehabilitation10.1152/physrev.00027.2016 ↗
41. Brain-Computer Interfaces: Definitions and Principles10.1016/B978-0-444-63934-9.00002-0 ↗
42. Rubber Hands ‘Feel’ Touch That Eyes See10.1038/35784 ↗
43. Embodying Functionally Relevant Action Sounds in Patients with Spinal Cord Injury10.1038/s41598-018-34133-z ↗
44. Visual Realism Enhances Realistic Response in an Immersive Virtual Environment10.1109/MCG.2009.55 ↗
45. Android Feedback-Based Training Modulates Sensorimotor Rhythms during Motor Imagery10.1109/TNSRE.2018.2792481 ↗
46. Audio-Visual Feedback Improves the BCI Performance in the Navigational Control of a Humanoid Robot10.3389/fnbot.2014.00020 ↗
47. Zhang, B., Zhou, Z., and Jiang, J. (2020). A 36-Class Bimodal Erp Brain-Computer Interface Using Location-Congruent Auditory-Tactile Stimuli. Brain Sci., 10.10.3390/brainsci10080524 ↗
48. The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews10.1136/bmj.n71 ↗
49. A systematic literature review of empirical evidence on computer games and serious games10.1016/j.compedu.2012.03.004 ↗
50. Serious Game Design and Clinical Improvement in Physical Rehabilitation: Systematic Review10.2196/20066 ↗
51. Navigating in Virtual Worlds Using a Self-Paced SSVEP-Based Brain-Computer Interface with Integrated Stimulation and Real-Time Feedback10.1162/PRES_a_00075 ↗
52. Effect of Biased Feedback on Motor Imagery Learning in BCI-Teleoperation System10.3389/fnsys.2014.00052 ↗
53. Alimardani, M., Nishio, S., and Ishiguro, H. (2016). The Importance of Visual Feedback Design in BCIs; from Embodiment to Motor Imagery Learning. PLoS ONE, 11.10.1371/journal.pone.0161945 ↗
54. Removal of Proprioception by BCI Raises a Stronger Body Ownership Illusion in Control of a Humanlike Robot10.1038/srep33514 ↗
55. Motor Priming in Virtual Reality Can Augment Motor-Imagery Training Efficacy in Restorative Brain-Computer Interaction: A within-Subject Analysis10.1186/s12984-016-0173-2 ↗
56. Local and Remote Cooperation with Virtual and Robotic Agents: A P300 BCI Study in Healthy and People Living with Spinal Cord Injury10.1109/TNSRE.2016.2626391 ↗
57. Progressive Training for Motor Imagery Brain-Computer Interfaces Using Gamification and Virtual Reality Embodiment10.3389/fnhum.2019.00329 ↗
58. Choi, J.W., Huh, S., and Jo, S. (2020). Improving Performance in Motor Imagery BCI-Based Control Applications via Virtually Embodied Feedback. Comput. Biol. Med., 127.10.1016/j.compbiomed.2020.104079 ↗
59. The influence of body movement on subjective presence in virtual environments10.1518/001872098779591368 ↗
60. Movement imagery ability: Development and assessment of a revised version of the vividness of movement imagery questionnaire10.1123/jsep.30.2.200 ↗
61. Embodiment, Ownership and Disownership
62. Intermediate Sensory Feedback Assisted Multi-Step Neural Decoding for Reinforcement Learning Based Brain-Machine Interfaces10.1109/TNSRE.2022.3210700 ↗
63. Incorporating Feedback from Multiple Sensory Modalities Enhances Brain-Machine Interface Control10.1523/JNEUROSCI.3967-10.2010 ↗
64. Visual Realism Enhances Realistic Response in an Immersive Virtual Environment—Part 210.1109/MCG.2012.121 ↗
65. OpenViBE: An Open-Source Software Platform to Design, Test, and Use Brain-Computer Interfaces in Real and Virtual Environments10.1162/pres.19.1.35 ↗
66. Aging, Gender, and Spinal Cord Injury10.1016/j.apmr.2003.06.022 ↗
67. Sex and Gender Gap in Spinal Cord Injury Research: Focus on Cardiometabolic Diseases. A Mini Review10.1016/j.maturitas.2021.03.004 ↗
68. Bashford, L., and Mehring, C. (2016). Ownership and Agency of an Independent Supernumerary Hand Induced by an Imitation Brain-Computer Interface. PLoS ONE, 11.10.1371/journal.pone.0156591 ↗
69. Embodied Neurofeedback with an Anthropomorphic Robotic Hand10.1038/srep37696 ↗
70. Mind Control? Creating Illusory Intentions through a Phony Brain-Computer Interface10.1016/j.concog.2010.05.007 ↗