Surround by Sound: A Review of Spatial Audio Recording and Reproduction
Source abstract
Abstract
In this article, a systematic overview of various recording and reproduction techniques for spatial audio is presented. While binaural recording and rendering is designed to resemble the human two-ear auditory system and reproduce sounds specifically for a listener’s two ears, soundfield recording and reproduction using a large number of microphones and loudspeakers replicate an acoustic scene within a region. These two fundamentally different types of techniques are discussed in the paper. A recent popular area, multi-zone reproduction, is also briefly reviewed in the paper. The paper is concluded with a discussion of the current state of the field and open problems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Speech and Audio Processing · Hearing Loss and Rehabilitation · Music and Audio Processing
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Research School of Engineering, College of Engineering and Computer Science, The Australian National University, Canberra 2601 ACT, Australia
Center of Intelligent Acoustics and Immersive Communications, Northwestern Polytechnical University, 127 Youyi West Road, Xi’an 710072, Shaanxi, China
Funding
Australian Research Council · National Natural Science Foundation of China
References (100+)
Show source-provided references
1. Methods for binaural recording and reproduction
2. Fundamentals of binaural technology10.1016/0003-682X(92)90046-U ↗
3. Natural listening over headphones in augmented reality using adaptive filtering techniques10.1109/TASLP.2015.2460459 ↗
4. Natural sound rending for headphones: Integration of signal processing techniques10.1109/MSP.2014.2372062 ↗
5. Stereophonic earphones and binaural loudspeakers
6. On crosstalk cancellation and equalization with multiple loudspeakers for 3-D sound reproduction10.1109/LSP.2007.898329 ↗
7. Psychophysics and neuronal bases of sound localization in humans10.1016/j.heares.2013.07.008 ↗
8. Auditory distance perception in humans: A review of cues, development, neuronal bases and effects of sensory loss10.3758/s13414-015-1015-1 ↗
9. (2017, April 26). Oculus Rift|Oculus. Available online: https://www.oculus.com/rift/.
10. (2017, April 26). PlayStation VR—Virtual Reality Headset for PS4. Available online: https://www.playstation.com/en-us/explore/playstation-vr/.
11. Abhayapala, T.D., and Ward, D.B. Theory and design of high order sound field microphones using spherical microphone array. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Orlando, FL, USA.
12. Meyer, J., and Elko, G. A highly scalable spherical microphone array based on an orthonormal decomposition of the soundfield. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Orlando, FL, USA.
13. Three-dimensional surround sound systems based on spherical harmonics
14. Samarasinghe, P.N., Abhayapala, T.D., and Poletti, M.A. Spatial soundfield recording over a large area using distributed higher order microphones. Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), New Paltz, NY, USA.
15. (2017, April 26). Dolby Atmos Audio Technology. Available online: https://www.dolby.com/us/en/brands/dolby-atmos.html.
16. (2017, April 26). Auro-3D/Auro Technologies: Three-dimensional Sound. Available online: http://www.auro-3d.com/.
17. Introduction to Head-Related Transfer Functions (HRTFs): Representations of HRTFs in time, frequency and space
18. Efficient HRTF-based spatial audio for area and volumetric sources10.1109/TVCG.2016.2518134 ↗
19. (2017, March 10). Neumann—Current Microphones, Dummy Head KU-100 Description. Available online: http://www.neumann.com/?lang=en&id=current_microphones&cid=ku100_description.
20. (2017, March 10). Brüel & Kjær—4128C, Head and Torso Simulator HATS. Available online: http://www.bksv.com/Products/transducers/ear-simulators/head-and-torso/hats-type-4128c?tab=overview.
21. (2017, March 10). 3Dio—The Free Space Binaural Microphone. Available online: http://3diosound.com/index.php?main_page=product_info&cPath=33&products_id=45.
22. Localization using nonindividualized head-related transfer functions10.1121/1.407089 ↗
23. Near-field virtual audio displays10.1162/105474602317343686 ↗
24. Numerical study on source distance dependency of head-related transfer functions10.1121/1.3111860 ↗
25. Multiple exponential sweep method for fast measurment of head related transfer functions
26. Inter-laboratory round robin HRTF measurement comparison10.1109/JSTSP.2015.2400417 ↗
27. Duraiswami, R., Zotkin, D.N., and Gumerov, N.A. Interpolation and range extrapolation of HRTFs. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Montreal, QC, Canada.
28. Sound field analysis along a circle and its applications to HRTF interpolation
29. Maximal azimuthal resolution needed in measurements of head-related transfer functions10.1121/1.3087433 ↗
30. Directional resolution of head-related transfer functions required in binaural synthesis
31. Zhang, W., Abhayapala, T.D., Kennedy, R.A., and Duraiswami, R. (2009, January 19–24). Modal expansion of HRTFs: Continuous representation in frequency-range-angle. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Taipei, Taiwan.10.1109/ICASSP.2009.4959576 ↗
32. Empirical determination of frequency representation in spherical harmonics-based HRTF functional modeling10.1109/TASLP.2014.2381881 ↗
33. Insights into head-related transfer function: Spatial dimensionality and continuous representation10.1121/1.3336399 ↗
34. On high-resolution head-related transfer function measurements: An efficient sampling scheme
35. Novel sampling scheme on the sphere for head-related transfer function measurements10.1109/TASLP.2015.2419971 ↗
36. Transfer-function measurement with sweeps
37. Fast head-related transfer function measurement via reciprocity10.1121/1.2207578 ↗
38. The fast measurment of head related impulse responses for all azimuthal directions using the continuous measurement method with a servoswiveled chair10.1016/j.apacoust.2006.09.009 ↗
39. He, J., Ranjan, R., and Gan, W.-S. (2016, January 20–25). Fast continuous HRTF acquisition with unconstrained movements of human subjects. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Shanghai, China.10.1109/ICASSP.2016.7471689 ↗
40. Majdak, P., Iwaya, Y., and Carpentier, T. (2013, January 4–7). Spatially oriented format for acoustics: A data exchange format representing head-related transfer functions. Proceedings of the 134th Audio Engineering Society Convention, Rome, Italy.
41. Rendering localized spatial audio in a virtual auditory scene10.1109/TMM.2004.827516 ↗
42. Xie, B. (2013). Head-Related Transfer Function and Virtual Auditory Display, J Ross Publishing.
43. Head-related transfer function interpolation in azimuth, elevation, and distance10.1121/1.4828983 ↗
44. Efficient binaural rendering of moving sound sources using HRTF interpolation10.1080/09298215.2011.594894 ↗
45. Creating interactive virtual acoustic environments
46. Freeland, F.P., Biscinho, L.W.P., and Diniz, P.S.R. (2002, January 15–17). Efficient HRTF interpolation in 3D moving sound. Proceedings of the 22nd AES International Conference: Virtual, Synthetic, and Entertainment Audio, Espoo, Finland.
47. A model of HeadRelated Transfer Functions based on Principal Components Analysis and Minimum-Phase reconstruction10.1121/1.402444 ↗
48. Efficient real spherical harmonic representation of head-related transfer function10.1109/JSTSP.2015.2421876 ↗
49. Zotkin, D.N., Hwang, J., Duraiswami, R., and Davis, L.S. (2003, January 19–22). HRTF personalization using anthropometric measurements. Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), New Paltz, NY, USA.
50. HRTF personalization based on airtificial neural network in individual virtual auditory space10.1016/j.apacoust.2007.05.007 ↗
51. Li, L., and Huang, Q. (2013, January 26–31). HRTF personalization modeling based on RBF neural network. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Vancouver, BC, Canada.10.1109/ICASSP.2013.6638350 ↗
52. Grindlay, G., and Vasilescu, M.A.O. (2007, January 16–20). A multilinear (tensor) framework for HRTF analysis and synthesis. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Honolulu, HI, USA.10.1109/ICASSP.2007.366641 ↗
53. On the relation between pinna reflection patterns and head-related transfer functon features10.1109/TASL.2012.2227730 ↗
54. Geronazzo, M., Spagnol, S., Bedin, A., and Avanzini, F. (2014, January 4–9). Enhancing vertical localization with image-guided selection of non-individual head-related transfer functions. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Florence, Italy.10.1109/ICASSP.2014.6854446 ↗
55. Zhang, M., Kennedy, R.A., Abhayapala, T.D., and Zhang, W. (June, January 30). Statistical method to identify key anthropometric parameters in HRTF individualization. Proceedings of the Hands-free Speech Communication and Microphone Arrays (HSCMA), Edinburgh, UK.
56. Bilinski, P., Ahrens, J., Thomas, M.R.P., Tasheve, I.J., and Platt, J.C. (2014, January 4–9). HRTF magnitude synthesis via sparse representation of anthropometric features. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Florence, Italy.10.1109/ICASSP.2014.6854447 ↗
57. Tasheve, I.J. (2014, January 9–14). HRTF phase synthesis via sparse representation of anthropometric features. Proceedings of the Information Theory and Applications Workshop (ITA), San Diego, CA, USA.10.1109/ITA.2014.6804239 ↗
58. He, J., Gan, W.-S., and Tan, E.-L. (2015, January 19–24). On the preprocessing and postprocessing of HRTF individualizaion based on sparse representation of anthropometric features. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Brisbane, Australia.10.1109/ICASSP.2015.7178047 ↗
59. Individualization of head related transfer functions using principal component analysis10.1016/j.apacoust.2014.07.005 ↗
60. Individualization of binaural synthesis using frontal projection headphones
61. Computing interaural differences through finite element modeling of idealized human heads10.1121/1.4927491 ↗
62. Boundary element method calculation of individual head-related transfer function. I. Rigid model calculation10.1121/1.1412440 ↗
63. Fast calculation system specialized for head-related transfer function based on boundary element method10.1121/1.2191608 ↗
64. Influence of voxelization on finite difference time domain simulations of head-related transfer functions10.1121/1.4947546 ↗
65. Mokhtari, P., Takemoto, H., Nishimura, R., and Kato, H. (2013, January 26–28). Preliminary estimation of the first peak of HRTFs from pinna anthropometry for personalized 3D audio. Proceedings of the 5th International Conference on Three Dimensional Systems and Applications, Osaka, Japan.
66. Creating the sydney york morphological and acoustic recordings of ears database10.1109/TMM.2013.2282134 ↗
67. Relevance of spectral cues for auditory spatial processing in the occipital cortex of the blind10.3389/fpsyg.2011.00048 ↗
68. Discrimination of virtual auditory distance using level and direct-to-reverberant ratio cues10.1121/1.4824395 ↗
69. Resolution of front-back ambiguity in spatial hearing by listener and source movement
70. Evidence for enhanced discrimination of virtual auditory distance among blind listeners using level and direct-to-reverberant cues10.1007/s00221-012-3340-0 ↗
71. Shinn-Cunningham, B.G. (2001, January 26-28). Distance cues for virtual auditory space. Proceedings of the IEEE Pacific Rim Conference (PRC) on Multimedia, Sydney, Australia.
72. Image method for efficiently simulating small-room acoustics10.1121/1.382599 ↗
73. Fifty years of artificial reverberation10.1109/TASL.2012.2189567 ↗
74. Headphone-based virtual spatialization of sound with a GPU accelerator
75. Guided multiview ray tracing for fast auralization10.1109/TVCG.2012.27 ↗
76. On the standardization of the frequency response of high-quality studio headphones
77. Estimating head-related transfer functions of human subjects from pressure-velocity measurements10.1121/1.3699230 ↗
78. Perceptual evaluation of headphone compensation in binaural synthesis based on non-individual recordings
79. Boren, B., Geronazzo, M., Brinkmann, F., and Choueiri, E. (2015, January 6–10). Coloration metrics for headphone equalization. Proceedings of the 21st International Conference on Auditory Display, Graz, Austria.
80. Robustness to head misalignment of virtual sound imaging system10.1121/1.1349539 ↗
81. Local sound field reproduction using two closely spaced loudspeakers10.1121/1.423763 ↗
82. Optimal source distribution for binaural synthesis over loudspeakers10.1121/1.1513363 ↗
83. Optimal design of loudspeaker arrays for robust cross-talk cancellation using the Taguchi method and the generic algorithm10.1121/1.1880852 ↗
84. Sound localization in individualized and non-individualized crosstalk cancellation systems10.1121/1.4792355 ↗
85. Lacouture-Parodi, Y., and Habets, E.A. (2012, January 4–6). Crosstalk cancellation system using a head tracker based on interaural time differences. Proceedings of the International Workshop on Acoustic Signal Enahcancement, Aachen, Germany.
86. Williams, E.G. (1999). Fourier Acoustics: Sound Radiation and Nearfield Acoustical Holography, Academic Press.10.1016/B978-012753960-7/50007-3 ↗
87. Reproduction of a plane-wave sound field using an array of loudspeakers10.1109/89.943347 ↗
88. (2017, March 10). Core Sound TetraMic. Available online: http://www.core-sound.com/TetraMic/1.php.
89. (2017, March 10). Eigenmike Microphone. Available online: https://www.mhacoustics.com/products#eigenmike1.
90. Gerzon, M.A. (1975, January 4–7). The design of precisely conincident microphone arrays for stereo and surround sound. Proceedings of the 50th Audio Engineering Society Covention, London, UK.
91. Spherical harmonic analysis of wavefields using multiple circular sensor arrays10.1109/TASL.2009.2038821 ↗
92. Theory and design of compact hybrid microphone arrays on two-dimensional planes for three-dimensional soundfield analysis10.1121/1.4934953 ↗
93. Wavefield analysis over large areas using distributed higher order microphones10.1109/TASLP.2014.2300341 ↗
94. Localization of amplitude-panned virtual sources, Part 1: Stereophonic panning
95. Localization of amplitude-panned virtual sources, Part 2: Two and three dimensional panning
96. Virtual sound source positioning using vector base amplitude panning
97. Lossius, T., Baltazar, P., and de la Hogue, T. (2009, January 16–21). DBAP—distance-based amplitude panning. Proceedings of the 2009 International Computer Music Conference, Montreal, QC, Canada.
98. (2017, April 26). VBAP Demo. Available online: http://legacy.spa.aalto.fi/software/vbap/VBAP_demo/.
99. (2017, April 26). Developers—3D Sound Labs. Available online: http://www.3dsoundlabs.com/category/developers/.
100. Approach to recreating a sound field10.1121/1.1911002 ↗