Head-Related Transfer Functions for Dynamic Listeners in Virtual Reality
Source abstract
Abstract
In dynamic virtual reality, visual cues and motor actions aid auditory perception. With multimodal integration and auditory adaptation effects, generic head-related transfer functions (HRTFs) may yield no significant disadvantage to individual HRTFs regarding accurate auditory perception. This study compares two individual HRTF sets against a generic HRTF set by way of objective analysis and two subjective experiments. First, auditory-model-based predictions examine the objective deviations in localization cues between the sets. Next, the HRTFs are compared in a static subjective (N=8) localization experiment. Finally, the localization accuracy, timbre, and overall quality of the HRTF sets are evaluated subjectively (N=12) in a six-degrees-of-freedom audio-visual virtual environment. The results show statistically significant objective deviations between the sets, but no perceived localization or overall quality differences in the dynamic virtual reality.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Multisensory perception and integration · Hearing Loss and Rehabilitation · Tactile and Sensory Interactions
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
International Audio Laboratories Erlangen, 91058 Erlangen, Germany
Fraunhofer Institute for Integrated Circuits, 91058 Erlangen, Germany
Faculty of Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91058 Erlangen, Germany
References (45)
Show source-provided references
1. Head related transfer functions of human subjects
2. Localization using nonindividualized head-related transfer functions10.1121/1.407089 ↗
3. Localization of real and virtual sound sources10.1121/1.413219 ↗
4. Virtual localization improved by scaling non-individualized external-ear transfer functions in frequency10.1121/1.427147 ↗
5. Oberem, J., Richter, J.G., Setzer, D., Seibold, J., Koch, I., and Fels, J. (2020). Experiments on localization accuracy with non-individual and individual HRTFs comparing static and dynamic reproduction methods. bioRxiv, 1–11.10.1101/2020.03.31.011650 ↗
6. Best, V., Baumgartner, R., Lavandier, M., Majdak, P., and Kopčo, N. (2020). Sound externalization: A review of recent research. Trends Hear., 24.10.1177/2331216520948390 ↗
7. On sound localization10.1121/1.1915985 ↗
8. Direct comparison of the impact of head tracking, reverberation, and individualized head-related transfer functions on the spatial perception of a virtual speech source
9. Free-field localization performance with a head-tracked virtual auditory display10.1109/JSTSP.2015.2421874 ↗
10. Sound localization with head movement: Implications for 3-d audio displays10.3389/fnins.2014.00210 ↗
11. Self-translation induced minimum audible angle10.1121/1.5064957 ↗
12. Ben-Hur, Z., Alon, D.L., Robinson, P.W., and Mehra, R. (2020, January 13). Localization of virtual sounds in dynamic listening using sparse HRTFs. Proceedings of the Audio Engineering Society International Conference on Audio for Virtual and Augmented Reality, Online.
13. Usability of individualized head-related transfer functions in virtual reality: Empirical study with perceptual attributes in sagittal plane sound localization10.2196/17576 ↗
14. Rummukainen, O.S., Robotham, T., Plinge, A., Wefers, F., Herre, J., and Habets, E.A.P. (2019, January 26–28). Listening tests with individual versus generic head-related transfer functions in six-degrees-of-freedom virtual reality. Proceedings of the 5th International Conference on Spatial Audio (ICSA), Ilmenau, Germany.
15. Blau, M., Budnik, A., Fallahi, M., Steffens, H., Ewert, S.D., and van de Par, S. (2021). Toward realistic binaural auralizations—Perceptual comparison between measurement and simulation-based auralizations and the real room for a classroom scenario. Acta Acust., 5.10.1051/aacus/2020034 ↗
16. Armstrong, C., Thresh, L., Murphy, D., and Kearney, G. (2018). A perceptual evaluation of individual and non-individual HRTFs: A case study of the SADIE II database. Appl. Sci., 8.10.3390/app8112029 ↗
17. Head-related transfer function recommendation based on perceptual similarities and anthropometric features10.1121/10.0002884 ↗
18. Spagnol, S. (2020). HRTF selection by anthropometric regression for improving horizontal localization accuracy. IEEE Signal Process. Lett., 1–5.10.1109/LSP.2020.2983633 ↗
19. Sikström, E., Geronazzo, M., Kleimola, J., Avanzini, F., de Götzen, A., and Serafin, S. (2018, January 4–7). Virtual reality exploration with different head-related transfer functions. Proceedings of the 15th Sound and Music Computing Conference, Limassol, Cyprus.
20. Assessing the impact of head-related transfer function individualization on task performance: Case of a virtual reality shooter game10.17743/jaes.2020.0004 ↗
21. Merging the senses into a robust percept10.1016/j.tics.2004.02.002 ↗
22. Rapid head-related transfer function adaptation using a virtual auditory environment10.1121/1.3687448 ↗
23. Generic HRTFs may be good enough in virtual reality. Improving source localization through cross-modal plasticity10.3389/fnins.2018.00021 ↗
24. Auditory accommodation to poorly matched non-individual spectral localization cues through active learning10.1038/s41598-018-37873-0 ↗
25. Short-term effects of sound localization training in virtual reality10.1038/s41598-019-54811-w ↗
26. Updating spatial hearing abilities through multisensory and motor cues10.1016/j.cognition.2020.104409 ↗
27. Fast and persistent adaptation to new spectral cues for sound localization suggests a many-to-one mapping mechanism10.1121/1.4960568 ↗
28. Richter, J.G., Behler, G., and Fels, J. (2016, January 4–7). Evaluation of a fast HRTF measurement system. Proceedings of the Audio Engineering Society 140th Convention, Paris, France.
29. Computation of the head-related transfer function via the fast multipole accelerated boundary element method and its spherical harmonic representation10.1121/1.3257598 ↗
30. Larcher, V., Jot, J.M., and Vandernoot, G. (1998, January 26–29). Equalization methods in binaural technology. Proceedings of the Audio Engineering Society 105th Convention, San Francisco, CA, USA.
31. Blauert, J. (2013). The auditory modeling toolbox. The Technology of Binaural Listening, Springer.10.1007/978-3-642-37762-4 ↗
32. Auditory model based direction estimation of concurrent speakers from binaural signals10.1016/j.specom.2010.05.006 ↗
33. Just noticeable differences of spatial cues in echoic and anechoic acoustical environments10.1121/1.4964844 ↗
34. Modeling sound-source localization in sagittal planes for human listeners10.1121/1.4887447 ↗
35. Schinkel-Bielefeld, N., Lotze, N., and Nagel, F. (2013, January 2–7). Audio quality evaluation by experienced and inexperienced listeners. Proceedings of the Meetings on Acoustics, Montreal, QC, Canada.10.1121/1.4799190 ↗
36. Stecker, G.C. (2016, January 4–7). Exploiting envelope fluctuations to enhance binaural perception. Proceedings of the Audio Engineering Society 140th Convention, Paris, France.
37. Robotham, T., Rummukainen, O., and Habets, E.A.P. (2018, January 17–20). Evaluation of binaural renderers in virtual reality environments: Platform and examples. Proceedings of the Audio Engineering Society 145th Convention, New York, NY, USA.
38. Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences, Routledge. [2nd ed.].
39. A cross-evaluated database of measured and simulated HRTFs including 3D head meshes, anthropometric features, and headphone impulse responses10.17743/jaes.2019.0024 ↗
40. Headphone simulation of free-field listening. II: Psychophysical validation10.1121/1.397558 ↗
41. 3-D localization of virtual sound sources: Effects of visual environment, pointing method, and training10.3758/APP.72.2.454 ↗
42. Rummukainen, O., Wang, J., Li, Z., Robotham, T., Yan, Z., Li, Z., Xie, X., Nagel, F., and Habets, E.A.P. (2018, January 17–20). Influence of visual content on the perceived audio quality in virtual reality. Proceedings of the 145th Audio Engineering Society International Convention, New York, NY, USA.
43. Fidelity of three-dimensional-sound reproduction using a virtual auditory display10.1121/1.428321 ↗
44. The role of reverberation-related binaural cues in the externalization of speech10.1121/1.4928132 ↗
45. Werner, S., Klein, F., Mayenfels, T., and Brandenburg, K. (2016, January 6–8). A summary on acoustic room divergence and its effect on externalization of auditory events. Proceedings of the 8th International Conference on Quality of Multimedia Experience, Lisbon, Portugal.10.1109/QoMEX.2016.7498973 ↗