journal article·2020-01-07Open access

Auditory Coding of Reaching Space

Ursula Fehse, Gerd Schmitz, Daniela Hartwig, Shashank Ghai, Heike Brock, Alfred O. Effenberg

Applied Sciences· Volume 10· Issue 2

Abstract

Reaching movements are usually initiated by visual events and controlled visually and kinesthetically. Lately, studies have focused on the possible benefit of auditory information for localization tasks, and also for movement control. This explorative study aimed to investigate if it is possible to code reaching space purely by auditory information. Therefore, the precision of reaching movements to merely acoustically coded target positions was analyzed. We studied the efficacy of acoustically effect-based and of additional acoustically performance-based instruction and feedback and the role of visual movement control. Twenty-four participants executed reaching movements to merely acoustically presented, invisible target positions in three mutually perpendicular planes in front of them. Effector-endpoint trajectories were tracked using inertial sensors. Kinematic data regarding the three spatial dimensions and the movement velocity were sonified. Thus, acoustic instruction and real-time feedback of the movement trajectories and the target position of the hand were provided. The subjects were able to align their reaching movements to the merely acoustically instructed targets. Reaching space can be coded merely acoustically, additional visual movement control does not enhance reaching performance. On the basis of these results, a remarkable benefit of kinematic movement acoustics for the neuromotor rehabilitation of everyday motor skills can be assumed.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Tactile and Sensory Interactions · Motor Control and Adaptation · Muscle activation and electromyography studies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Humanities, Institute of Sports Science, Leibniz University Hannover, 30167 Hanover, Germany

School of Physical & Occupational Therapy (SPOT), McGill University, Montreal, QC H3G 1Y5, Canada

Honda Research Institute Japan Co., Ltd., Wako-shi, Saitama 351-0188, Japan

Funding

European Regional Development Fund

References (62)

Show source-provided references
1. Vectorial coding of movement: Vision, proprioception, or both?10.1152/jn.1995.74.1.457 ↗
2. Is reaching eye-centered, body-centered, hand-centered, or a combination?10.1515/REVNEURO.2001.12.2.175 ↗
3. Visual control of reaching movements without vision of the limb10.1007/BF00238848 ↗
4. Substituting auditory for visual feedback to adapt to altered dynamic and kinematic environments during reaching10.1007/s00221-012-3144-2 ↗
5. Schmitz, G., and Bock, O. (2014). A Comparison of Sensorimotor Adaptation in the Visual and in the Auditory Modality. PLoS ONE, 9.10.1371/journal.pone.0107834 ↗
6. From ear to hand: The role of the auditory-motor loop in pointing to an auditory source10.3389/fncom.2013.00026 ↗
7. A review on the relationship between sound and movement in sports and rehabilitation10.3389/fpsyg.2019.00244 ↗
8. Movement sonification: Effects on perception and action10.1109/MMUL.2005.31 ↗
9. Effect-and performance-based auditory feedback on interpersonal coordination10.3389/fpsyg.2018.00404 ↗
10. An investigation of online acoustic information for elite rowers in on-water training conditions10.4100/jhse.2011.62.20 ↗
11. Effects of acoustic feedback training in elite-standard Para-Rowing10.1080/02640414.2014.946438 ↗
12. On the auditory-proprioception substitution hypothesis: Movement sonification in two deafferented subjects learning to write new characters10.3389/fnins.2017.00137 ↗
13. SoundScript-Supporting the acquisition of character writing by multisensory integration10.2174/1874350101508010230 ↗
14. Movement sonification: Effects on motor learning beyond rhythmic adjustments10.3389/fnins.2016.00219 ↗
15. Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review10.3758/s13423-012-0333-8 ↗
16. See me, hear me, touch me: Multisensory integration in lateral occipital-temporal cortex10.1016/j.conb.2005.03.011 ↗
17. Listening to a walking human activates the temporal biological motion area10.1016/j.neuroimage.2005.06.018 ↗
18. Multimodal motion processing in area V5/MT: Evidence from an artificial class of audio-visual events10.1016/j.brainres.2008.10.067 ↗
19. Bangert, M., and Altenmüller, E.O. (2003). Mapping perception to action in piano practice: A longitudinal DC-EEG study. BMC Neurosci., 4.10.1186/1471-2202-4-26 ↗
20. Empathy and the somatotopic auditory mirror system in humans10.1016/j.cub.2006.07.072 ↗
21. Multimodal action representation in human left ventral premotor cortex10.1007/s10339-007-0165-z ↗
22. Action representation of sound: Audiomotor recognition network while listening to newly acquired actions10.1523/JNEUROSCI.4822-06.2007 ↗
23. Schmitz, G., Mohammadi, B., Hammer, A., Heldmann, M., Samii, A., Münte, T.F., and Effenberg, A.O. (2013). Observation of sonified movements engages a basal ganglia frontocortical network. BMC Neurosci., 14.10.1186/1471-2202-14-32 ↗
24. Recognising one’s own motor actions through sound: The role of temporal factors10.1068/p7227 ↗
25. Perceiving and reenacting spatiotemporal characteristics of walking sounds10.1037/a0029402 ↗
26. Pascolo, P.B. (2004). The relevance of auditory information in optimizing hammer throwers performance. Biomechanics and Sports, Springer.
27. Auditory coding of human movement kinematics10.1163/22134808-00002435 ↗
28. Fehse, U., Weber, A., Krüger, B., Baumann, J., and Effenberg, A.O. (2019, October 12). Intermodal Action Identification. Presented at the International Conference on Multisensory Motor Behavior: Impact of Sound [Online], Hanover, Germany, 30 September–1 October 2013; p. 4. Available online: http://www.sonification-online.com/wp-content/uploads/2013/12/Postersession_neu.pdf.
29. Learning to perceive with a visuo-auditory substitution system: Localisation and object recognition with ‘The Voice’10.1068/p5631 ↗
30. Fast, accurate reaching movements with a visual-to-auditory sensory substitution device
31. Multisensory-based Approach to the recovery of unisensory deficit10.1196/annals.1440.008 ↗
32. Sensori-motor learning with movement sonification: Perspectives from recent interdisciplinary studies10.3389/fnins.2016.00385 ↗
33. Sonification as a possible stroke rehabilitation strategy10.3389/fnins.2014.00332 ↗
34. Effect of task-related continuous auditory feedback during learning of tracking motion exercises10.1186/1743-0003-9-79 ↗
35. Rhythmic auditory stimulation in gait training for Parkinson’s disease patients10.1002/mds.870110213 ↗
36. Rhythmic facilitation of gait training in hemiparetic stroke rehabilitation10.1016/S0022-510X(97)00146-9 ↗
37. Kinematic optimization of spatiotemporal patterns in paretic arm training with stroke patients10.1016/S0028-3932(01)00141-5 ↗
38. Effect of rhythmic auditory cueing on aging gait: A systematic review and meta-analysis10.14336/AD.2017.1031 ↗
39. Effect of rhythmic auditory cueing on gait in cerebral palsy: A systematic review and meta-analysis10.2147/NDT.S148053 ↗
40. Effect of rhythmic auditory cueing on parkinsonian gait: A systematic review and meta-analysis10.1038/s41598-017-16232-5 ↗
41. The discovery of human auditory-motor entrainment and its role in the development of neurologic music therapy10.1016/bs.pbr.2014.11.030 ↗
42. Musical motor feedback (MMF) in walking hemiparetic stroke patients: Randomized trials of gait improvement10.1191/0269215503cr668oa ↗
43. Auditory cueing in Parkinson’s patients with freezing of gait. What matters most: Action-relevance or cue-continuity?10.1016/j.neuropsychologia.2016.04.034 ↗
44. Maulucci, R.A., and Eckhouse, R.H. (September, January 30). A real-time auditory feedback system for retraining gait. Proceedings of the 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA, USA.10.1109/IEMBS.2011.6091286 ↗
45. Effect of auditory feedback differs according to side of hemiparesis: A comparative pilot study10.1186/1743-0003-6-45 ↗
46. Sonification of arm movements in stroke rehabilitation—A novel approach in neurologic music therapy10.3389/fneur.2016.00106 ↗
47. Synthesis of walking sounds for alleviating gait disturbances in Parkinson’s disease10.1109/TNSRE.2013.2285410 ↗
48. Interaction between synesthetically corresponding dimensions10.1037/0096-3445.116.4.323 ↗
49. Musicians are more consistent: Gestural cross-modal mappings of pitch, loudness and tempo in real-time
50. (2019, October 12). Online Evaluation of Amusia—Public. Available online: http://www.brams.org/amusia-public.
51. On-line identification of congenital amusia10.1525/mp.2008.25.4.331 ↗
52. The use of wearable inertial motion sensors in human lower limb biomechanics studies: A systematic review10.3390/s101211556 ↗
53. Classification of trampoline jumps using inertial sensors10.1007/s12283-011-0081-4 ↗
54. If motion sounds: Movement sonification based on inertial sensor data10.1016/j.proeng.2012.04.095 ↗
55. Acceleration and deceleration at constant speed: Systematic modulation of motion perception by kinematic sonification10.1111/nyas.13693 ↗
56. Impairments of reaching movements in patients without proprioception. II. Effects of visual information on accuracy10.1152/jn.1995.73.1.361 ↗
57. Where is my arm? The relative role of vision and proprioception in the neuronal representation of limb position10.1073/pnas.96.18.10418 ↗
58. Schmitz, G., Kroeger, D., and Effenberg, A.O. (2014, January 22–25). A mobile sonification system for stroke rehabilitation. Proceedings of the Presented at the 20th International Conference on Auditory Display, New York, NY, USA.
59. Movement sonification in stroke rehabilitation10.3389/fneur.2018.00389 ↗
60. Wiemeyer, J., Seyfarth, A., Kollegger, G., Tokur, D., Schumacher, C., Hoffmann, K., and Schöberl, D. (2016, January 28–30). Instruction and real-time sonification for gait rehabilitation after unilateral hip arthroplasty. Proceedings of the Human Movement and Technology, Book of Abstracts—11th Joint Conference on Motor Control and Learning, Biomechanics and Training, Darmstadt, Germany.
61. Auditory concurrent feedback benefits on the circle performed in gymnastics10.1080/02640410500130979 ↗
62. Music supported therapy promotes motor plasticity in individuals with chronic stroke10.1007/s11682-015-9498-x ↗