Dynamic Binaural Rendering: The Advantage of Virtual Artificial Heads over Conventional Ones for Localization with Speech Signals
Source abstract
Abstract
As an alternative to conventional artificial heads, a virtual artificial head (VAH), i.e., a microphone array-based filter-and-sum beamformer, can be used to create binaural renderings of spatial sound fields. In contrast to conventional artificial heads, a VAH enables one to individualize the binaural renderings and to incorporate head tracking. This can be achieved by applying complex-valued spectral weights—calculated using individual head related transfer functions (HRTFs) for each listener and for different head orientations—to the microphone signals of the VAH. In this study, these spectral weights were applied to measured room impulse responses in an anechoic room to synthesize individual binaural room impulse responses (BRIRs). In the first part of the paper, the results of localizing virtual sources generated with individually synthesized BRIRs and measured BRIRs using a conventional artificial head, for different head orientations, were assessed in comparison with real sources. Convincing localization performances could be achieved for virtual sources generated with both individually synthesized and measured non-individual BRIRs with respect to azimuth and externalization. In the second part of the paper, the results of localizing virtual sources were compared in two listening tests, with and without head tracking. The positive effect of head tracking on the virtual source localization performance confirmed a major advantage of the VAH over conventional artificial heads.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Speech and Audio Processing · Hearing Loss and Rehabilitation · Indoor and Outdoor Localization Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Institut für Hörtechnik und Audiologie, Jade Hochschule Oldenburg, Ofener Straße 16–19, 26121 Oldenburg, Germany
Department of Medical Physics and Acoustics, Carl von Ossietzky University of Oldenburg, Carl-von-Ossietzky-Straße 11, 26129 Oldenburg, Germany
Cluster of Excellence Hearing4all, Carl-von-Ossietzky-Straße 11, 26129 Oldenburg, Germany
Akustik Technologie Göttingen, Bunsenstraße 9c, 37073 Göttingen, Germany
Funding
Bundesministerium für Bildung und Forschung
References (32)
Show source-provided references
1. Localization using nonindividualized head-related transfer functions10.1121/1.407089 ↗
2. Binaural Technique: Do we need individual recordings?
3. Oberem, J., Richter, J.G., Setzer, D., Seibold, J., Koch, I., and Fels, J. (2020). Experiments on localization accuracy with non-individual and individual HRTFs comparing static and dynamic reproduction methods. bioRxiv.10.1101/2020.03.31.011650 ↗
4. Direct Comparison of the Impact of Head Tracking, Reverberation, and Individualized Head-Related Transfer Functions on the Spatial Perception of a Virtual Speech Source
5. Brimijoin, W.O., Boyd, A.W., and Akeroyd, M.A. (2013). The Contribution of Head Movement to the Externalization and Internalization of Sounds. PLoS ONE, 8.10.1371/journal.pone.0083068 ↗
6. Free-Field Localization Performance With a Head-Tracked Virtual Auditory Display10.1109/JSTSP.2015.2421874 ↗
7. Sandvad, J. (1996, January 11–14). Dynamic aspects of auditory virtual environments. Proceedings of the 100th AES Convention, Copenhagen, Denmark.
8. Localization of real and virtual sound sources10.1121/1.413219 ↗
9. Regularization Approaches for Synthesizing HRTF Directivity Patterns10.1109/TASLP.2015.2504874 ↗
10. Perceptual Evaluation of Individualized Binaural Reproduction Using a Virtual Artificial Head10.17743/jaes.2017.0012 ↗
11. Fallahi, M., Hansen, M., Doclo, S., van de Par, S., Mellert, V., Püschel, D., and Blau, M. (2017, January 6–9). High spatial resolution binaural sound reproduction using a virtual artificial head. Proceedings of the Fortschritte der Akustik-DAGA, Kiel, Germany.
12. Blau, M., Budnik, A., Fallahi, M., Steffens, H., Ewert, S.D., and van de Par, S. (2021). Toward realistic binaural auralizations-perceptual comparison between measurement and simulation-based auralizations and the real room for a classroom scenario. Acta Acust., 5.10.1051/aacus/2020034 ↗
13. Fallahi, M., Hansen, M., Doclo, S., van de Par, S., Püschel, D., and Blau, M. (2021). Evaluation of head-tracked binaural auralizations of speech signals generated with a virtual artificial head in anechoic and classroom environments. Acta Acust., 5.10.1051/aacus/2021025 ↗
14. Two-Dimensional Synchronization Patterns for Minimum Ambiguity10.1109/TIT.1982.1056526 ↗
15. Rasumow, E., Blau, M., Hansen, M., Doclo, S., van de Par, S., Mellert, V., and Püschel, D. (July, January 27). Robustness of virtual artificial head topologies with respect to microphone positioning. Proceedings of the Forum Acusticum, Aalborg, Denmark.
16. Blauert, J. (1997). Spatial Hearing: The Psychophysics of Human Sound Localization, MIT Press. [revised ed.]. Chapter 2.10.7551/mitpress/6391.001.0001 ↗
17. Digital Filter Design for Inversion Problems in Sound Reproduction
18. Jaeger, H., Bitzer, J., Simmer, U., and Blau, M. (2017, January 6–9). Echtzeitfähiges binaurales Rendering mit Bewegungssensoren von 3-D Brillen. Proceedings of the Fortschritte der Akustik-DAGA, Kiel, Germany.
19. On the externalization of sound images10.1121/1.414965 ↗
20. Influence of head tracking on the externalization of speech stimuli for non-individualized binaural synthesis10.1121/1.4978612 ↗
21. Siegel, S., and Castellan, N.J. (1988). Non Parametric Statistics for Behavioural Sciences, McGraw-Hill, Inc.. [2nd ed.]. Chapter 7.
22. Cue weighting and vestibular mediation of temporal dynamics in sound localization via head rotation10.1121/1.4799913 ↗
23. The role of head movements and vestibular and visual cues in sound localization10.1037/h0054629 ↗
24. On the Acoustic Qualities of Dynamic Pseudobinaural Recordings10.17743/jaes.2020.0036 ↗
25. Resolution of front-back ambiguity in spatial hearing by listener and source movement10.1121/1.426899 ↗
26. The effect of head rotations on vertical plane sound localization10.1121/1.419642 ↗
27. Effect of induced head movements on localization of direction of sound10.1121/1.1910604 ↗
28. Headphone localization of speech10.1177/001872089303500210 ↗
29. Folds, D.J. (2006, January 16–20). The elevation illusion in virtual audio. Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting, San Francisco, CA, USA.10.1177/154193120605001613 ↗
30. Virtual localization improved by scaling nonindividualized external-ear transfer function in frequency10.1121/1.427147 ↗
31. Role of spectral cues in median plane localization10.1121/1.399963 ↗
32. Sound pressure generated in an external-ear replica and real human ears by a nearby point source10.1121/1.1911059 ↗