An Algorithm for Generating Virtual Sources in Dynamic Virtual Auditory Display Based on Tensor Decomposition of Head-Related Impulse Responses
Source abstract
Abstract
Dynamic virtual auditory displays (VADs) are increasingly used for generating various auditory objects and scenes in virtual and augmented reality. Dynamic VADs are required to generate virtual sources in various directions and distances by using HRTF- or HRIR-based binaural synthesis. In the present work, an algorithm for improving the efficiency and performance of binaural synthesis in dynamic VAD is proposed. Based on tensor decomposition, a full set of near-field HRIRs is decomposed as a combination of distance-, direction-, and time-related modes. Then, binaural synthesis in VAD can be implemented by a common set of time mode-related convolvers or filters associated with direction- and distance-related weights. Dynamic binaural signals are created by updating the weights rather than updating the HRIR-based convolvers, which enables the independent control of virtual source distance and direction and avoids the audible artifact caused by updating the HRIR-based convolvers. An example of implementation indicates that a set of eight common convolvers or filters for each ear is enough to synthesize the binaural signals with sufficient accuracy. The computational efficiency of simultaneously generating multiple virtual sources is improved when the number of virtual sources is larger than eight. A virtual-source localization experiment validates the algorithm.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Adaptive Filtering Techniques · Speech and Audio Processing · Blind Source Separation Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Acoustic Lab, School of Physics and Optoeletronics, South China University of Technology, Guangzhou 510641, China
Funding
National Natural Science Foundation of China
References (32)
Show source-provided references
1. Xie, B.S. (2013). Head-Related Transfer Function and Virtual Auditory Display, J Ross Publishing. [2nd ed.].
2. Larcher, V., Warusfel, O., Jot, J.M., and Guyard, J. (2000, January 19–22). Study and comparison of efficient methods for 3D audio spatialization based on linear decomposition of HRTF data. Proceedings of the 108th Audio Engineering Society Convention, Paris, France.
3. Analyzing head-related transfer function measurements using surface spherical harmonics10.1121/1.423749 ↗
4. Duraiswami, R., Zotkin, D.N., and Gumerov, N.A. (2004, January 17–21). Interpolation and range extrapolation of HRTFs. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Montreal, QC, Canada.10.1109/ICASSP.2004.1326759 ↗
5. Calculation of head-related transfer functions for arbitrary field points using spherical harmonics decomposition10.3813/AAA.918493 ↗
6. Jot, J.M., Wardle, S., and Larcher, V. (1998, January 26–29). Approaches to binaural synthesis. Proceedings of the 105th Audio Engineering Society Convention, San Francisco, CA, USA.
7. Noisternig, M., Sontacchi, A., Musil, T., and Holdrich, R. (2003, January 26–28). A 3D ambisonic based binaural sound reproduction system. Proceedings of the 24th International Conference: Multichannel Audio, The New Reality, Banff, AB, Canada.
8. Nearfield binaural synthesis and ambisonics10.1121/1.2434761 ↗
9. A model of head-related transfer functions based on principal components analysis and minimum-phase reconstruction10.1121/1.402444 ↗
10. A spatial feature extraction and regularization model for the head-related transfer function10.1121/1.413110 ↗
11. Recovery of individual head-related transfer functions from a small set of measurements10.1121/1.4728168 ↗
12. Platform for dynamic virtual auditory environment real-time rendering system10.1007/s11434-012-5523-2 ↗
13. Tensor decompositions for signal processing applications: From two-way to multiway component analysis10.1109/MSP.2013.2297439 ↗
14. Grindlay, G., and Vasilescu, M.A.O. (2007, January 15–20). A multilinear (tensor) framework for HRTF analysis and synthesis. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Honolulu, HI, USA.10.1109/ICASSP.2007.366641 ↗
15. Modeling individual HRTF tensor using high-order partial least squares10.1186/1687-6180-2014-58 ↗
16. Wang, J., Liu, M., Wang, X., Liu, T., and Xie, X. (2020). Prediction of head-related transfer function based on tensor completion. Appl. Acoust., 157.10.1016/j.apacoust.2019.08.001 ↗
17. Blauert, J. (1997). Spatial Hearing: The Psychophysics of Human Sound Localization, MIT Press. [Revised ed.].10.7551/mitpress/6391.001.0001 ↗
18. Auditory localization of nearby sources I, head-related transfer functions10.1121/1.427180 ↗
19. Auditory distance perception in humans: A summary of past and present research
20. Auditory distance perception in humans: A review of cues, development, neuronal bases, and effects of sensory loss10.3758/s13414-015-1015-1 ↗
21. Xie, B.S., and Yu, G.Z. (2021). Psychoacoustic Principle, Methods, and Problems with Perceived Distance Control in Spatial Audio. Appl. Sci., 11.10.3390/app112311242 ↗
22. Auditory distance perception in rooms10.1038/17374 ↗
23. Sensitivity of human subjects to head-related transfer-function phase spectra10.1121/1.426898 ↗
24. Rui, Y., Yu, G.Z., Xie, B.S., and Liu, Y. (2013, January 4–7). Calculation of individualized near-field head-related transfer function database using boundary element method. Proceedings of the 134th Audio Engineering Society Convention, Rome, Italy.
25. Perceptual consequences of engineering compromises in synthesis of virtual auditory objects10.1121/1.404982 ↗
26. Zhao, T., and Xie, B.S. (2019, January 9–13). Independent modes and dimensionality reduction of head-related transfer functions based on tensor decomposition. Proceedings of the 23rd International Congress on Acoustics, Aachen, Germany.
27. Effect of individualized head-related transfer functions on distance perception in virtual reproduction for a nearby sound source
28. Headphone simulation of free-field listening. II: Psychophysical validation10.1121/1.397558 ↗
29. The role of dynamic cue in auditory vertical localisation10.1016/j.apacoust.2018.12.002 ↗
30. Methods for spherical data analysis and visualization10.1016/S0165-0270(97)00201-X ↗
31. Zahorik, P. (2002, January 2–5). Auditory display of sound source distance. Proceedings of the 2002 International Conference on Auditory Display, Kyoto, Japan.
32. Dynamic binaural Ambisonics scheme for rendering distance information of free-field virtual sources