Spatial Audio for Soundscape Design: Recording and Reproduction
Source abstract
Abstract
With the advancement of spatial audio technologies, in both recording and reproduction, we are seeing more applications that incorporate 3D sound to create an immersive aural experience. Soundscape design and evaluation for urban planning can now tap into the extensive spatial audio tools for sound capture and 3D sound rendering over headphones and speaker arrays. In this paper, we outline a list of available state-of-the-art spatial audio recording techniques and devices, spatial audio physical and perceptual reproduction techniques, emerging spatial audio techniques for virtual and augmented reality, followed by a discussion on the degree of perceptual accuracy of recording and reproduction techniques in representing the acoustic environment.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Noise Effects and Management · Hearing Loss and Rehabilitation · Acoustic Wave Phenomena Research
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore
Maxim Integrated Products Inc., San Jose, CA 95129, USA
References (100+)
Show source-provided references
1. What is soundscape ecology? An introduction and overview of an emerging new science10.1007/s10980-011-9600-8 ↗
2. The ideal urban soundscape: Investigating the sound quality of French cities
3. Schulte-Fortkamp, B. (2002, January 18). Soundscapes and living spaces sociological and psychological aspects concerning acoustical environments. Proceedings of the Forum Acusticum, Sevilla, Spain.
4. Influence of urban contexts on soundscape perceptions: A structural equation modeling approach10.1016/j.landurbplan.2015.05.004 ↗
5. Schafer, R.M. (1977). The Soundscape: Our Sonic Environment and the Tuning of the World, Destiny Books.
6. Ten questions on the soundscapes of the built environment10.1016/j.buildenv.2016.08.011 ↗
7. International Organization for Stadardization (2014). Acoustics—Soundscape—Part 1: Definition and Conceptual Framework, ISO. ISO 12913-1.
8. Herranz-Pascual, K., Aspuru, I., and García, I. (2010, January 13–16). Proposed conceptual model of environmental experience as framework to study the soundscape. Proceedings of the 39th International Congress and Exposition on Noise Control Engineering (INTERNOISE), Lisbon, Portugal.
9. Zwicker, E., and Fastl, H. (2013). Psychoacoustics: Facts and Models, Springer Science & Business Media.
10. A review of progress in soundscapes and an approach to soundscape planning
11. Soundscape descriptors and a conceptual framework for developing predictive soundscape models10.1016/j.landurbplan.2016.02.001 ↗
12. A grounded theory approach to the subjective understanding of urban soundscape in Sheffield10.1016/j.cities.2015.08.002 ↗
13. Soundscape analysis in a residential area: An evaluation of noise and people’s mind
14. Soundscape and sound preferences in urban squares: A case study in sheffield10.1080/13574800500062395 ↗
15. De Coensel, B., Bockstael, A., Dekoninck, L., Botteldooren, D., Schulte-Fortkamp, B., Kang, J., and Nilsson, M.E. (2010, January 13–16). The soundscape approach for early stage urban planning: A case study. Pcoceedings of the Internoise, Lisbon, Portugal.
16. Ecological Validity of soundscape reproduction
17. International Organization for Stadardization (2017). Acoustics—Soundscape Part 2: Data Collection and Reporting Requirements, ISO. ISO 123913-2.
18. Vorländer, M. (2008). Auralization, Springer-Verlag Berlin Heidelberg.
19. Designing sound and visual components for enhancement of urban soundscapes10.1121/1.4817924 ↗
20. Semantic differential analysis of the soundscape in urban open public spaces10.1016/j.buildenv.2009.05.014 ↗
21. Soundscape reproduction and synthesis10.3813/AAA.918708 ↗
22. The effect of sound level on perception of reproduced soundscapes10.1016/j.apacoust.2016.03.011 ↗
23. Immersive virtual reality and environmental noise assessment: An innovative audio-visual approach10.1016/j.eiar.2013.01.007 ↗
24. On the validity of immersive virtual reality as tool for multisensory evaluation of urban spaces10.1016/j.egypro.2015.11.703 ↗
25. Immersive virtual reality in community planning: Acoustic and visual congruence of simulated vs real world10.1016/j.scs.2016.06.022 ↗
26. Site-specific soundscape design for the creation of sonic architectures and the emergent voices of buildings10.3390/buildings4010001 ↗
27. Natural listening over headphones in augmented reality using adaptive filtering techniques10.1109/TASLP.2015.2460459 ↗
28. Boren, B., Musick, M., Grossman, J., and Roginska, A. (2014, January 22–25). I hear NY4D: Hybrid acoustic and augmented auditory display for urban soundscapes. Proceedings of the 20th International Conference on Auditory Display, New York, NY, USA.
29. Eargle, J. (2012). The Microphone Book: From Mono to Stereo to Surround—A Guide to Microphone Design and Application, CRC Press.10.4324/9780080473468 ↗
30. Bartlett, B., and Bartlett, J. (2016). Practical Recording Techniques: The Step-by-Step Approach to Professional Audio Recording, CRC Press.10.4324/9781315696331 ↗
31. Huber, D.M., and Runstein, R.E. (2013). Modern Recording Techniques, CRC Press.10.4324/9780240824642 ↗
32. Symposium on wire transmission of symphonic music and its reproduction in auditory perspective basic requirements10.1002/j.1538-7305.1934.tb00660.x ↗
33. Rossing, T.D. (2015). Springer Handbook of Acoustics, Springer.10.1007/978-1-4939-0755-7 ↗
34. Benesty, J., Chen, J., and Huang, Y. (2008). Microphone Array Signal Processing, Springer Science & Business Media.
35. Rafaely, B. (2015). Fundamentals of Spherical Array Processing, Springer.10.1007/978-3-662-45664-4 ↗
36. Brüel & Kjær (2016, December 05). Sound and Vibration Advanced Options for Holography and Beamforming. Available online: http://www.bksv.com/Products/analysis-software/acoustics/noise-source-identification/spherical-beamforming-8606?tab=descriptions.
37. Nokia OZO (2016, December 05). Virtual Reality Camera with 360-Degree Audio and Video Capture. Available online: https://ozo.nokia.com/.
38. Motion-tracked binaural sound
39. (2016, December 28). mh Acoustics Eigenmike® Microphone. Available online: https://mhacoustics.com/products.
40. (2017, February 03). Visisonics Products Visisonics. Available online: http://visisonics.com/products-2/#3daudio.
41. (2016, December 05). Mathworks Phased Array Gallery—MATLAB & Simulink Example. Available online: https://www.mathworks.com/help/phased/examples/phased-array-gallery.html.
42. Soundwalking and the Bodily Exploration of Places10.22230/cjc.2012v37n1a2543 ↗
43. Brüel & Kjær (2016, December 15). Sound & Vibration Type 4101-B-Binaural in-Ear Microphone Set. Available online: http://www.bksv.com/Products/transducers/acoustic/binaural-headsets/4101?tab=overview.
44. Vorländer, M. (2004, January 13–17). Past, present and future of dummy heads. Proceedings of the Acustica, Guimarães, Portugal.
45. G.R.A.S (2017, June 13). Head & Torso Simulators. Available online: http://www.gras.dk/products/head-torso-simulators-kemar.html.
46. Brüel & Kjær (2016, December 22). Sound & Vibration TYPE 4128-C HATS. Available online: https://www.bksv.com/en/products/transducers/ear-simulators/head-and-torso/hats-type-4128c.
47. (2016, December 18). HEAD Acoustics Binaural Recording Systems—Artificial Head System HMS IV—Product Description. Available online: https://www.head-acoustics.de/eng/nvh_hms_IV.htm.
48. (2016, December 25). Georg Neumann GmbH Products/Current Microphones/KU 100/Description. Available online: https://www.neumann.com/?lang=en&id=current_microphones&cid=ku100_description.
49. Width-height sound reproduction
50. Sennheiser (2017, June 13). Sennheiser AMBEO VR MIC—Microphone 3D AUDIO Capture. Available online: https://en-us.sennheiser.com/microphone-3d-audio-ambeo-vr-mic.
51. (2016, December 28). Core Sound TeraMic. Available online: http://www.core-sound.com/TetraMic/1.php.
52. SoundField (2016, December 28). SoundField SPS200 Software Controlled Microphone|Microphones and Processors with Unique Surround Sound Capabilities. Available online: http://www.soundfield.com/products/sps200.
53. Bates, E., Dooney, S., Gorzel, M., O’Dwyer, H., Ferguson, L., and Boland, F.M. (2016). Comparing ambisonic microphones: Part 1. Audio Engineering Society Conference on Sound Field Control, Audio Engineering Society.
54. A principal components model of soundscape perception10.1121/1.3493436 ↗
55. The effects of audio-visual factors on perceptions of environmental noise barrier performance10.1016/j.landurbplan.2014.02.001 ↗
56. The acoustic and visual factors influencing the construction of tranquil space in urban and rural environments tranquil spaces-quiet places?10.1121/1.2831735 ↗
57. Genres and techniques of soundscape composition as developed at Simon Fraser University10.1017/S1355771802001024 ↗
58. Boren, B., Andreopoulou, A., Musick, M., Mohanraj, H., and Roginska, A. (2004). I hear NY3D: Ambisonic capture and reproduction of an urban sound environment. 135th Audio Engineering Society Convention (2013), Audio Engineering Society Convention.
59. He, J. (2017). Spatial Audio Reproduction with Primary Ambient Extraction, Springer Singapore.10.1007/978-981-10-1551-9 ↗
60. British Patent Specification 394,325
61. Prospects for transaural recording
62. A 3D audio augmented reality system for a cultural heritage management and fruition
63. Vogel, C., Maffiolo, V., Polack, J.-D., and Castellengo, M. (1997, January 14–18). Validation subjective de la prise de son en extérieur. Proceedings of the Congrès Français D’acoustique 97, Marseille, France.
64. The production of a perceived restorativeness soundscape scale10.1016/j.apacoust.2011.11.005 ↗
65. (1997). Methods for the Subjective Assessment of Small Impairments in Audio Systems Including Multichannel Sound Systems, International Telecommunication Union.
66. Perceptual evaluation of multi-dimensional spatial audio reproduction10.1121/1.1763973 ↗
67. Ambisonics part one: General system description
68. Bruce, N.S., Davies, W.J., and Adams, M.D. (2009, January 23–26). Development of a soundscape simulator tool. Proceedings of the 38th International Congress and Exposition on Noise Control Engineering 2009, INTER-NOISE, Ottawa, ON, Canada.
69. (2017, June 13). Omnitone. Available online: http://googlechrome.github.io/omnitone/#home.
70. (2017, June 13). BBC R & D Surround Sound with Height—BBC R & D. Available online: http://www.bbc.co.uk/rd/projects/surround-sound-with-height.
71. (2017, June 12). Facebook 360. Available online: https://facebook360.fb.com/spatial-workstation/.
72. Gilkey, R.H., and Anderson, T.R. (1997). An Introduction to Binaural Technology, Springer.
73. Ranjan, R. (2016). 3D Audio Reproduction: Natural Augmented Reality Headset and Next Generation Entertainment System Using Wave Field Synthesis. [Ph.D. Thesis, School of Electrical and Electronic Engineering].
74. 3-D sound for virtual reality and multimedia10.2307/3680997 ↗
75. Individualization of binaural synthesis using frontal projection headphones
76. He, J., Ranjan, R., and Gan, W.S. (2016, January 20–25). Fast continuous HRTF acquisition with unconstrained movements of human subjects. Proceedings of the 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Shanghai, China.10.1109/ICASSP.2016.7471689 ↗
77. Ranjan, R., He, J., and Gan, W.-S. (2016, January 24). Fast continuous acquisition of HRTF for human subjects with unconstrained random head movements in azimuth and elevation. Proceedings of the Audio Engineering Society Conference: 2016 AES International Conference on Headphone Technology, Aalborg, Denmark.
78. Gardner, W.G. (1995). Transaural 3D Audio, MIT Media Laboratory.
79. Guastavino, C., Larcher, V., Catusseau, G., and Boussard, P. (2007, January 26–29). Spatial audio quality evaluation: Comparing transaural, ambisonics and stereo. Proceedings of the 13th International Conference on Auditory Display, Montréal, QC, Canada.
80. SIGGRAPH (2017, June 12). “Sounds Good to Me” SIGGRAPH 2002 Course Notes. Available online: https://www.cs.princeton.edu/~funk/course02.pdf.
81. Vorländer, M. (2008). Auralization: Fundamentals of Acoustics, Modelling, Simulation, Springer.
82. Pätynen, J., and Lokki, T. (2010, January 29–31). Evaluation of concert hall auralization with virtual symphony orchestra. Proceedings of the International Symposium on Room Acoustics, Melbourne, Australia.
83. Rindel, J.H. (2002, January 19). Modelling in auditorium acoustics–from ripple tank and scale models to computer simulations. Proceedings of the Forum Acusticum, Sevilla, Spain.
84. The influence of traffic flow dynamics on urban soundscapes10.1016/j.apacoust.2004.07.012 ↗
85. Numerical modeling of the sound fields in urban squares10.1121/1.1904483 ↗
86. Numerical modelling of the sound field near a tall building with balconies near a road10.1006/jsvi.1996.0584 ↗
87. Pellegrini, R.S. (August, January 29). Quality assessment of auditory virtual environments. Proceedings of the 2001 International Conference on Auditory Display, Espoo, Finland.
88. Begault, D.R. (2000). 3-D Sound for Virtual Reality and Multimedia, Academic Press Professional, Inc.
89. Natural sound rendering for headphones: Integration of signal processing techniques10.1109/MSP.2014.2372062 ↗
90. Towards the integration of urban sound planning in urban development processes: The study of four test sites within the SONORUS project
91. The influence of visual characteristics of barriers on railway noise perception10.1016/j.scitotenv.2012.12.025 ↗
92. The effects of vision-related aspects on noise perception of wind turbines in quiet areas10.3390/ijerph10051681 ↗
93. (2017, March 22). Meta 2. Available online: https://www.metavision.com/.
94. Microsoft (2017, June 12). Microsoft HoloLens. Available online: https://www.microsoft.com/microsoft-hololens/en-us.
95. Augmented reality audio for mobile and wearable appliances
96. Tikander, M., Karjalainen, M., and Riikonen, V. (2008, January 1–4). An augmented reality audio headset. Proceedings of the International Conference on Digital Audio Effects (DAFx-08), Espoo, Finland.
97. Gupta, R., Lam, B., Hong, J., Ong, Z., and Gan, W. (2017, January 23–27). 3D audio VR capture and reproduction setup for auralization of soundscapes. Proceedings of the 24th International Congress on Sound and Vibration, London, UK.
98. Assessing the plausibility of virtual acoustic environments10.3813/AAA.918562 ↗
99. Assessment of the masking effects of birdsong on the road traffic noise environment10.1121/1.4960570 ↗
100. Measurement-based auralization methodology for the assessment of noise mitigation measures10.1016/j.jsv.2016.05.039 ↗