journal article·2022-02-26Open access

Predicting the Colouration between Binaural Signals

Thomas McKenzie, Cal Armstrong, Lauren Ward, Damian T. Murphy, Gavin Kearney

Applied Sciences· Volume 12· Issue 5

Abstract

Although the difference between the fast Fourier transforms of two audio signals is often used as a basic measure of predicting perceived colouration, these signal measures do not provide information on how relevant the results are from a perceptual point of view. This paper presents a perceptually motivated loudness calculation for predicting the colouration between binaural signals which incorporates equal loudness frequency contouring, relative subjective loudness weighting, cochlea frequency modelling, and an iterative normalisation of input signals. The validation compares the presented model to three other colouration calculations in two ways: using test signals designed to evaluate specific elements of the model, and against the results of a listening test on degraded binaural audio signals. Results demonstrate the presented model is appropriate for predicting the colouration between binaural signals.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Hearing Loss and Rehabilitation · Speech and Audio Processing · Acoustic Wave Phenomena Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Acoustics Lab, Department of Signal Processing and Acoustics, Aalto University, 00076 Espoo, Finland

AudioLab, Department of Electronic Engineering, University of York, York YO10 5DQ, UK

Department of Theatre, Film, Television and Interactive Media, University of York, York YO10 5GB, UK

Funding

Google Faculty Research Award

References (52)

Show source-provided references
1. Standardizing auditory tests10.1121/1.1917190 ↗
2. Bregman, A.S. (1990). Auditory Scene Analysis: The Perceptual Organization of Sound, The MIT Press.10.7551/mitpress/1486.001.0001 ↗
3. On the relative importance of spatial and timbral fidelities in judgments of degraded multichannel audio quality10.1121/1.1945368 ↗
4. Schärer, Z., and Lindau, A. (2009, January 7–10). Evaluation of equalization methods for binaural signals. Proceedings of the 126th Convention of the Audio Engineering Society, Munich, Germany.
5. The relationship between basic audio quality and overall listening experience10.1121/1.4963078 ↗
6. Wiggins, B., Paterson-Stephens, I., and Schillebeeckx, P. (2001, January 21–24). The analysis of multi-channel sound reproduction algorithms using HRTF data. Proceedings of the AES 19th International Conference, Schloss Elmau, Germany.
7. Numerical study on source-distance dependency of head-related transfer functions10.1121/1.3111860 ↗
8. An initial validation of individualized crosstalk cancellation filters for binaural perceptual experiments
9. On distance dependence of pinna spectral patterns in head-related transfer functions10.1121/1.4903919 ↗
10. Yost, W.A., and Fay, R.R. (2007). Auditory Perception of Sound Sources, Springer Science & Business Media.10.1007/978-0-387-71305-2 ↗
11. Loudness, its definition, measurement and calculation10.1002/j.1538-7305.1933.tb00403.x ↗
12. Relation between loudness and masking10.1121/1.1915904 ↗
13. The measurement of loudness10.1121/1.1908048 ↗
14. Über psychologische und methodische Grundlagen der Lautheit
15. A model of loudness summation10.1037/h0021703 ↗
16. Dependence of binaural loudness summation on interaural level differences, spectral distribution, and temporal distribution10.1121/1.1894635 ↗
17. A revision of Zwicker’s loudness model
18. A model for the prediction of thresholds, loudness, and partial loudness
19. PEAQ—The ITU standard for objective measurement of perceived audio quality
20. Frank, M. (2013). Phantom Sources Using Multiple Loudspeakers in the Horizontal Plane. [Ph.D. Thesis, University of Music and Performing Arts Graz].
21. Zotter, F., Frank, M., and Haar, C. (2015, January 16–19). Spherical microphone array equalization for Ambisonics. Proceedings of the Fortschritte der Akustik DAGA 2015, Nuremberg, Germany.
22. Binaural rendering of Ambisonic signals by HRIR time alignment and a diffuseness constraint10.1121/1.5040489 ↗
23. Schörkhuber, C., Zaunschirm, M., and Höldrich, R. (2018, January 19–22). Binaural rendering of Ambisonic signals via magnitude least squares. Proceedings of the DAGA 2018, Munich, Germany.
24. Analyzing virtual sound source attributes using a binaural auditory model
25. Karjalainen, M. (1996, January 9). Binaural auditory model for sound quality measurements and spatial hearing studies. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Atlanta, GA, USA.
26. Localization of amplitude-panned virtual sources. I: Stereophonic panning
27. Ono, K., Pulkki, V., and Karjalainen, M. (December, January 30). Binaural modeling of multiple sound source perception: Methodology and coloration experiments. Proceedings of the 111th Convention of the Audio Engineering Society, New York, NY, USA.
28. Ono, K., Pulkki, V., and Karjalainen, M. (2002, January 10–13). Binaural modeling of multiple sound source perception: Coloration of wideband sound. Proceedings of the 112th Convention of the Audio Engineering Society, Munich, Germany.
29. Hameed, S., and Pulkki, V. (2004, January 8–10). Modeling of coloration of virtual sound sources in listening rooms. Proceedings of the Baltic-Nordic Acoustics Meeting, Mariehamn, Åland, Finland.
30. The contribution of two ears to the perception of vertical angle in sagittal planes10.1121/1.1352084 ↗
31. Rix, A.W., Beerends, J.G., Hollier, M.P., and Hekstra, A. (2001, January 7–11). Perceptual evaluation of speech quality (PESQ)—A new method for speech quality assessment of telephone networks and codecs. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Salt Lake City, UT, USA.
32. The solid angle of a plane triangle10.1109/TBME.1983.325207 ↗
33. International Organization for Standardization (2003). Normal Equal-Loudness-Level Contours (Standard No. ISO 226:2003).
34. Perceptual weights for loudness judgments of six-tone complexes10.1121/1.4887478 ↗
35. Perceptually based head-related transfer function database optimization10.1121/1.3672641 ↗
36. Auditory spectral discrimination and the localization of clicks in the sagittal plane10.1121/1.407481 ↗
37. Sound transmission to and within the human ear canal10.1121/1.415856 ↗
38. Zwicker, E., and Fastl, H. (2013). Psychoacoustics: Facts and Models, Springer Science and Business Media.
39. Researches in loudness measurement10.1109/TAU.1966.1161864 ↗
40. The audibility of frequency response irregularities
41. Suggested formulae for calculating auditory-filter bandwidths and excitation patterns10.1121/1.389861 ↗
42. Kabal, P. (2002). An Examination and Interpretation of ITU-R BS. 1387: Perceptual Evaluation of Audio Quality, McGill University. Technical Report.
43. Härmä, A., and Palomäki, K. (1999, January 16–17). HUTear—A free Matlab toolbox for modeling of auditory system. Proceedings of the Matlab DSP Conference, Tampere, Finland.
44. Farina, A. (2000, January 19–22). Simultaneous measurement of impulse response and distortion with a swept-sine technique. Proceedings of the 108th Convention of the Audio Engineering Society, Paris, France.
45. Digital filter design for inversion problems in sound reproduction
46. Generalized fractional-octave smoothing of audio and acoustic responses
47. International Telecommunication Union (2015). ITU-R BS.1534-2: Method for the Subjective Assessment of Intermediate Quality Level of Audio Systems BS Series Broadcasting Service, International Telecommunication Union. Technical Report.
48. webMUSHRA—A comprehensive framework for web-based listening tests10.5334/jors.187 ↗
49. Bernschütz, B. (2013, January 18–21). A spherical far field HRIR/HRTF compilation of the Neumann KU 100. Proceedings of the Fortschritte der Akustik–AIA-DAGA 2013, Merano, Italy.
50. Schäfer, M., Bahram, M., and Vary, P. (2013, January 26–31). An extension of the PEAQ measure by a binaural hearing model. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Vancouver, BC, Canada.10.1109/ICASSP.2013.6639256 ↗
51. Assessment and prediction of binaural aspects of audio quality10.17743/jaes.2017.0037 ↗
52. A convolutional neural-network model of human cochlear mechanics and filter tuning for real-time applications10.1038/s42256-020-00286-8 ↗