journal article·2021-12-30Open access

Effect of Environment-Related Cues on Auditory Distance Perception in the Context of Audio-Only Augmented Reality

Vincent Martin, Isabelle Viaud-Delmon, Olivier Warusfel

Applied Sciences· Volume 12· Issue 1

Abstract

Audio-only augmented reality consists of enhancing a real environment with virtual sound events. A seamless integration of the virtual events within the environment requires processing them with artificial spatialization and reverberation effects that simulate the acoustic properties of the room. However, in augmented reality, the visual and acoustic environment of the listener may not be fully mastered. This study aims to gain some insight into the acoustic cues (intensity and reverberation) that are used by the listener to form an auditory distance judgment, and to observe if these strategies can be influenced by the listener’s environment. To do so, we present a perceptual evaluation of two distance-rendering models informed by a measured Spatial Room Impulse Response. The choice of the rendering methods was made to design stimuli categories in which the availability and reproduction quality of acoustic cues are different. The proposed models have been evaluated in an online experiment gathering 108 participants who were asked to provide judgments of auditory distance about a stationary source. To evaluate the importance of environmental cues, participants had to describe the environment in which they were running the experiment, and more specifically the volume of the room and the distance to the wall they were facing. It could be shown that these context cues had a limited, but significant, influence on the perceived auditory distance.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Multisensory perception and integration · Hearing Loss and Rehabilitation · Noise Effects and Management

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Sorbonne Université, Ircam, CNRS, Ministère de la Culture, Sciences et Technologies de la Musique et du Son, STMS, F-75004 Paris, France

References (42)

Show source-provided references
1. Blauert, J. (1997). Spatial Hearing: The Psychophysics of Human Sound Localization, MIT Press.10.7551/mitpress/6391.001.0001 ↗
2. Werner, S., Klein, F., Mayenfels, T., and Brandenburg, K. (2016, January 6–8). A summary on acoustic room divergence and its effect on externalization of auditory events. Proceedings of the IEEE 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX), Lisbon, Portugal.10.1109/QoMEX.2016.7498973 ↗
3. Auditory distance perception in humans: A review of cues, development, neuronal bases, and effects of sensory loss10.3758/s13414-015-1015-1 ↗
4. Auditory distance perception in humans: A summary of past and present research
5. Effect of stimulus spectrum on distance perception for nearby sources10.1121/1.3613705 ↗
6. Auditory distance perception in rooms10.1038/17374 ↗
7. Bronkhorst, A.W. (2002). Modeling Auditory Distance Perception in Rooms, Forum Acusticum.
8. Room-induced cues for the perception of virtual auditory distance with stimuli equalized in level10.3813/AAA.918933 ↗
9. On the minimum audible difference in direct-to-reverberant energy ratio10.1121/1.2936368 ↗
10. Do we need two ears to perceive the distance of a virtual frontal sound source?10.1121/10.0001954 ↗
11. Werner, S., and Füg, S. (2012, January 22–25). Controlled Auditory Distance Perception using Binaural Headphone Reproduction–Evaluation via Listening Tests. Proceedings of the 27th Tonmeistertagung, VDT International Convention, Cologne, Germany.
12. Assessing auditory distance perception using virtual acoustics10.1121/1.1458027 ↗
13. The role of vision in auditory distance perception10.1068/p7153 ↗
14. The impact of a visual spatial frame on real sound-source localization in virtual reality10.1016/j.crbeha.2020.100003 ↗
15. Intermodality interactions in spatial localization10.1016/0010-0285(70)90008-3 ↗
16. The role of visual-auditory “compellingness” in the ventriloquism effect: Implications for transitivity among the spatial senses10.3758/BF03202010 ↗
17. Auditory environmental context affects visual distance perception10.1038/s41598-017-06495-3 ↗
18. Sound externalization: A review of recent research
19. Carpentier, T., Noisternig, M., and Warusfel, O. (October, January 25). Twenty years of Ircam Spat: Looking back, looking forward. Proceedings of the 41st International Computer Music Conference (ICMC), Denton, TX, USA.
20. The subjective masking of short time delayed echoes by their primary sounds and their contribution to the intelligibility of speech
21. Modifying chambers to play billiards: The foundations of reverberation theory
22. Abel, J.S., Huang, P., Abel, J.S., and Huang, P. (2006). A simple, robust measure of reverberation echo density. Audio Engineering Society Convention 121, Audio Engineering Society.
23. Stewart, R., and Sandler, M. (2007, January 10–15). Statistical measures of early reflections of room impulse responses. Proceedings of the 10th International Conference on Digital Audio Effects (DAFx-07), Bordeaux, France.
24. Massé, P., Carpentier, T., Warusfel, O., and Noisternig, M. (2020). Denoising directional room impulse responses with spatially anisotropic late reverberation tails. Appl. Sci., 10.10.3390/app10031033 ↗
25. Jot, J.M., Cerveau, L., and Warusfel, O. (1997). Analysis and synthesis of room reverberation based on a statistical time-frequency model. Audio Engineering Society Convention 103, Audio Engineering Society.
26. The minimum description length principle in coding and modeling10.1109/18.720554 ↗
27. Intensity discrimination as a function of frequency and sensation level10.1121/1.381278 ↗
28. PsychoPy2: Experiments in behavior made easy10.3758/s13428-018-01193-y ↗
29. Auditory/visual distance estimation: Accuracy and variability10.3389/fpsyg.2014.01097 ↗
30. Subjective scaling of spatial room acoustic parameters influenced by visual environmental cues10.1121/1.3478797 ↗
31. Reverberation cue as a control parameter of distance in virtual audio environment
32. Messonnier, J.C., and Moraud, A. (2011). Auditory distance perception: Criteria and listening room. Audio Engineering Society Convention 130, Audio Engineering Society.
33. A just noticeable difference in C50 for speech10.1016/S0003-682X(98)00075-9 ↗
34. Perception of the relative distances of nearby sound sources10.3758/BF03210871 ↗
35. Auditory localization of nearby sources. Head-related transfer functions10.1121/1.427180 ↗
36. Zahorik, P. (2002, January 2–5). Auditory display of sound source distance. Proceedings of the International Conference on Auditory Display, Kyoto, Japan.
37. Effects of room reflectance and background noise on perceived auditory distance10.1068/p180403 ↗
38. Auditory perception of reverberant surroundings10.1121/1.425625 ↗
39. Using acoustic information to perceive room size: Effects of blindness, room reverberation time, and stimulus10.1068/p7555 ↗
40. Cabrera, D., Jeong, C., Kwak, H.J., and Kim, J.Y. (2005, January 12–14). Auditory room size perception for modeled and measured rooms. Proceedings of the INTER-NOISE and NOISE-CON Congress and Conference Proceedings, Dearborn, MI, USA.
41. Distance perception in interactive virtual acoustic environments using first and higher order ambisonic sound fields10.3813/AAA.918492 ↗
42. The effect of vision on psychoacoustic testing with headphone-based virtual sound10.17743/jaes.2015.0061 ↗