journal article·2021-11-26Open access

Psychoacoustic Principle, Methods, and Problems with Perceived Distance Control in Spatial Audio

Bosun Xie, Guangzheng Yu

Applied Sciences· Volume 11· Issue 23

Abstract

One purpose of spatial audio is to create perceived virtual sources at various spatial positions in terms of direction and distance with respect to the listener. The psychoacoustic principle of spatial auditory perception is essential for creating perceived virtual sources. Currently, the technical means for recreating virtual sources in different directions of various spatial audio techniques are relatively mature. However, perceived distance control in spatial audio remains a challenging task. This article reviews the psychoacoustic principle, methods, and problems with perceived distance control and compares them with the principles and methods of directional localization control in spatial audio, showing that the validation of various methods for perceived distance control depends on the principle and method used for spatial audio. To improve perceived distance control, further research on the detailed psychoacoustic mechanisms of auditory distance perception is required.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Hearing Loss and Rehabilitation · Noise Effects and Management · Hearing, Cochlea, Tinnitus, Genetics

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Acoustic Lab, School of Physics and Optoeletronics, South China University of Technology, Guangzhou 510641, China

Funding

National Natural Science Foundation of China

References (75)

Show source-provided references
1. Spatial Sound—History, principle, progress and challenge10.1049/cje.2020.02.016 ↗
2. Blauert, J. (1997). Spatial Hearing: The Psychophysics of Human Sound Localization, MIT Press.10.7551/mitpress/6391.001.0001 ↗
3. Auditory/visual distance estimation: Accuracy and variability10.3389/fpsyg.2014.01097 ↗
4. Zahorik, P. (2002, January 2–5). Auditory display of sound source distance. Proceedings of the 2002 International Conference on Auditory Display, Kyoto, Japan.
5. Auditory distance perception in humans: A summary of past and present research
6. Auditory distance perception in humans: A review of cues, development, neuronal bases, and effects of sensory loss10.3758/s13414-015-1015-1 ↗
7. Xie, B.S. (2013). Head-Related Transfer Function and Virtual Auditory Display, J Ross Publishing. [2nd ed.].
8. Near-field head-related transfer-function measurement and database of human subjects10.1121/1.5027019 ↗
9. Auditory localization of nearby sources I, head-related transfer functions10.1121/1.427180 ↗
10. Auditory localization of nearby sources II, localization of a broadband source10.1121/1.427943 ↗
11. Auditory localization of nearby sources III, Stimulus effects10.1121/1.428212 ↗
12. Brungart, D.S. (1999, January 20–20). Auditory parallax effects in the HRTF for nearby sources. Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, New Paltz, NY, USA.
13. A modeling of distance perception based on auditory parallax model10.1121/1.422911 ↗
14. Kuttruff, H. (2009). Room Acoustics, Spon Press. [5th ed.].
15. Auditory distance perception in rooms10.1038/17374 ↗
16. Do we need two ear to perceive the distance of a virtual frontal sound source?10.1121/10.0001954 ↗
17. Effect of stimulus spectrum on distance perception for nearby sources10.1121/1.3613705 ↗
18. Auditory distance perception in different rooms
19. Effects of room size and reverberation, receiver location, and source rotation on acoustical metrics related to source localization10.3813/AAA.918558 ↗
20. The role of dynamic cue in auditory vertical localization10.1016/j.apacoust.2018.12.002 ↗
21. The dominant role of low-frequency interaural time difference in sound localization10.1121/1.402445 ↗
22. Pöntynen, H., Santala, O., and Pulkki, V. (2016, January 4–7). Conflicting dynamic and spectral directional cues form separate auditory images. Proceedings of the 140th Audio Engineering Society Convention, Paris, France.
23. Macpherson, E.A. (2011). Head Motion, Spectral Cues, and Wallach’s “Principle of Least Displacement” in Sound Localization, in Principles and Applications of Spatial Hearing, World Scientific Publishing Co. Pte. Ltd.10.1142/9789814299312_0009 ↗
24. The role of head movements and signal spectrum in an auditory front/back illusion10.1068/i7173sas ↗
25. Some measurements on the effects of interchannel intensity and time differences in two channel sound systems10.1121/1.1907824 ↗
26. On the directional localization of sound in the stereophonic sound field
27. Gerzon, M.A. (1992, January 24–27). General metatheory of auditory localisation. Proceedings of the 92nd Audio Engineering Society Convention, Vienna, Austria.
28. Analysis of and experiments on vertical summing localization of multichannel sound reproduction with amplitude panning10.17743/jaes.2019.0009 ↗
29. Level and time panning of phantom images for musical sources
30. The precedence effect10.1121/1.427914 ↗
31. Daniel, J., Nicol, R., and Moreau, S. (2003, January 22–25). Further investigations of high-order Ambisonics and wavefield synthesis for holophonic sound imaging. Proceedings of the 114th Audio Engineering Society Convention, Amsterdam, The Netherlands.
32. Rumsey, F. (2001). Spatial Audio, Focal Press.
33. Jot, J.M., Wardle, S., and Larcher, V. (1998, January 26–29). Approaches to binaural synthesis. Proceedings of the 105th Audio Engineering Society Convention, San Francisco, CA, USA.
34. Generalized transaural stereo and applications
35. Ambisonics in multichannel broadcasting and video
36. Three-dimensional surround sound systems based on spherical harmonics
37. Daniel, J. (2003, January 23–25). Spatial sound encoding including near field effect: Introducing distance coding filters and a viable, new Ambisonic format. Proceedings of the 23rd Audio Engineering Society International Conference, Copenhagen, Denmark.
38. Spatial sound field reproduction by wave field synthesis
39. Spors, S., Rabenstain, R., and Ahrens, J. (2008, January 17–20). The theory of wave field synthesis revisited. Proceedings of the 124th Audio Engineering Society Convention, Amsterdam, The Netherlands.
40. Spors, S., Wierstorf, H., Geier, M., and Ahrens, J. (2009, January 9–12). Physical and perceptual properties of focused virtual sources in wave field synthesis. Proceedings of the 127th Audio Engineering Society Convention, New York, NY, USA.
41. Reproduction of a plane-wave sound field using an array of loudspeakers10.1109/89.943347 ↗
42. Analysis with binaural auditory model and experiment on the timbre of Ambisonics recording and reproduction
43. Morrell, M.J., and Reiss, J.D. (2009, January 7–10). A comparative approach to sound localization within a 3-D sound field. Proceedings of the 126th Audio Engineering Society Convention, Munich, Germany.
44. Power, P., Davies, W.J., Hirst, J., and Dunn, C. (2012). Localisation of Elevated Virtual Sources in Higher Order Ambisonics Sound Fields, Institute of Acoustics.
45. Investigation on localisation accuracy for first and higher order Ambisonics reproduced sound sources10.3813/AAA.918643 ↗
46. Wierstorf, H., Raake, A., and Spors, S. (2012, January 26–29). Localization of a virtual point source within the listening area for wave field synthesis. Proceedings of the 133rd Audio Engineering Society Convention, San Francisco, CA, USA.
47. Reproduction of nearby sound sources using higher-order Ambisonics with practical loudspeaker arrays10.3813/AAA.918491 ↗
48. Reproduction of nearby sources by imposing true interaural differences on a sound field control approach10.1121/1.4930952 ↗
49. Distance perception in interactive virtual acoustic environment using first and higher order Ambisonic sound fields10.3813/AAA.918492 ↗
50. Perception of focused sources in wave field synthesis
51. Sontacchi, A., and Hoeldrich, R. (2000, January 7–9). Enhanced 3D sound field synthesis and reproduction using system by compensating interfering reflections. Proceedings of the DAFX-00, Verona, Italy.
52. Cancellation of room reflections over an extended area using Ambisonics10.1121/1.5023326 ↗
53. Interaural crosscorrelation for multichannel loudspeaker reproduction
54. Multichannel 3D microphone arrays: A review10.17743/jaes.2020.0069 ↗
55. Local Ambisonics panning method for creating virtual source in the vertical plane of the frontal hemisphere10.1016/j.apacoust.2020.107319 ↗
56. Assessing auditory distance perception using virtual acoustics10.1121/1.1458027 ↗
57. Platform for dynamic virtual auditory environment real-time rendering system10.1007/s11434-012-5523-2 ↗
58. Effect of individualized head-related transfer functions on distance perception in virtual reproduction for a nearby sound source
59. Distance-dependent head-related transfer functions measured with high spatial resolution using a spark gap10.1109/TASL.2009.2020532 ↗
60. Arend, J.M., Neidhardt, A., and Hristoph Porschmann, C. (2016, January 17–20). Measurement and perceptual evaluation of a spherical near-field HRTF set. Proceedings of the 29th Tonmeistertagung-Vdt International Convention, Cologne, Germany.
61. Near-field head-related transfer functions of an artificial head and its characteristics (in Chinese)
62. Directivity of Spherical Polyhedron Sound Source Used in Near-Field HRTF Measurements10.1088/0256-307X/27/12/124302 ↗
63. Range dependence of the response of a spherical head model10.1121/1.423886 ↗
64. Gumerov, N.A., Duraiswami, R., and Tang, Z. (2002, January 13–17). Numerical study of the influence of the torso on the HRTF. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Orlando, FL, USA.10.1109/ICASSP.2002.1006155 ↗
65. Calculation and analysis of near-field head-related transfer functions from a simplified head-neck-torso model10.1088/0256-307X/29/3/034302 ↗
66. Numerical study on source-distance dependency of head-related transfer functions10.1121/1.3111860 ↗
67. Salvador, G.D., Sakamoto, S., Treviño, J., and Suzuki, Y. (2018, January 6–9). Dataset of near-distance head-related transfer functions calculated using the boundary element method. Proceedings of the Audio Engineering Society Convention on Spatial Reproduction, Tokyo, Japan.
68. Duraiswami, R., Zotkin, D.N., and Gumerov, N.A. (2004, January 17–21). Interpolation and range extrapolation of HRTFs. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Montreal, QC, Canada.10.1109/ICASSP.2004.1326759 ↗
69. Calculation of head-related transfer functions for arbitrary field points using spherical harmonics decomposition10.3813/AAA.918493 ↗
70. A psychophysical evaluation of near-field head-related transfer functions synthesized using a distance variation function10.1121/1.3081395 ↗
71. Nearfield binaural synthesis and ambisonics10.1121/1.2434761 ↗
72. Dynamic binaural Ambisonics scheme for rendering distance information of free-field virtual sources
73. Creating interactive virtual acoustic environments
74. Werner, S., and Liebetrau, J. (2013, January 3–5). Effects of shaping of binaural room impulse responses on localization. Proceedings of the Fifth International Workshop on Quality of Multimedia Experience (QoMEX), Klagenfurt am Wörthersee, Austria.10.1109/QoMEX.2013.6603216 ↗
75. Lee, H., Mironovs, M., and Johnson, D. (2019, January 20–23). Binaural Rendering of Phantom Image Elevation using VHAP. Proceedings of the 146th Audio Engineering Society Convention, Dublin, Ireland.