Immersive Two-Channel Recordings Based on Personalized BRIRs and Their Applications in Industry
Source abstract
Abstract
The realm of immersive sound technologies in modern industries is evolving every day. Two-channel recordings using personalized HRIRs or BRIRs, which are tailored to the unique anatomical features of individual listeners, significantly enhance the spatial accuracy and naturalness of sound, providing a highly immersive auditory experience. This paper discusses the importance of immersive sound and the externalization effect in recreating the acoustic environment. The paper also presents techniques for obtaining two-channel immersive renderings in a few different ways. The main focus is the integration of immersive audio in new technologies in the wide-ranging audio industry, from telecommunication, through applications for musicians, virtual reality scenarios, and hearing devices. In summary, this paper highlights the huge potential of personalized BRIRs in creating immersive two-channel recordings, offering substantial benefits across various industries by improving the realism and effectiveness of each auditory experience on its own.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Image and Video Quality Assessment · Music Technology and Sound Studies · Advanced Optical Imaging Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Systems, Signals and Electronics Engineering, Faculty of Electrical Engineering, West Pomeranian University of Technology in Szczecin, al. Piastów 17, 70-310 Szczecin, Poland
References (68)
Show source-provided references
1. Markus, M., Bruhn, S., Torres, J., Fotopoulou, E., Toftgård, T., Norvell, E., Döhla, S., Gao, Y., Su, H.-y., and Laaksonen, L. (2024, January 8–10). Immersive Voice and Audio Services (IVAS) codec—The new 3GPP standard for immersive communication. Proceedings of the 157th AES Convention, New York, NY, USA.
2. (2024, October 30). Available online: https://www.sennheiser.com/en-ie/immersive/ambeo-spatial-audio.
3. Sinclair, J.-L. (2020). Principles of Game Audio and Sound Design: Sound Design and Audio Implementation for Interactive and Immersive Media, Focal Press. [1st ed.].10.4324/9781315184432 ↗
4. Jot, J.-M., Audfray, R., Hertensteiner, M., and Schmidt, B. (2021, January 8–10). Rendering Spatial Sound for Interoperable Experiences in the Audio Metaverse. Proceedings of the 2021 Immersive and 3D Audio: From Architecture to Automotive (I3DA), Bologna, Italy.10.1109/I3DA48870.2021.9610971 ↗
5. Effective soundscape characterisation of an acoustic metamaterial-based window: A comparison between laboratory and online methods10.1016/j.apacoust.2022.108754 ↗
6. Hedges, J., Sazdov, R., and Johnston, A. (2023, January 5–7). Measuring the influence of audio on immersive experience in extended reality and digital games: A systematic review. Proceedings of the 2023 Immersive and 3D Audio: From Architecture to Automotive (I3DA), Bologna, Italy.10.1109/I3DA57090.2023.10289267 ↗
7. Gan, W.S., Peksi, S., He, J., Ranjan, R., Hai, N.D., and Chaudhary, N.K. (2017). Personalized HRTF Measurement and 3D Audio Rendering for AR/VR Headsets, Immerzen Labs Pte. Ltd.. Paper 331.
8. Cipresso, P., Giglioli, I.A.C., Raya, M.A., and Riva, G. (2018). The past, present, and future of virtual and augmented reality research: A network and cluster analysis of the literature. Front. Psychol., 9.10.3389/fpsyg.2018.02086 ↗
9. Rogers, K., Ribeiro, G., Wehbe, R.R., Weber, M., and Nacke, L.E. (2018, January 21–26). Vanishing Importance: Studying Immersive Effects of Game Audio Perception on Player Experiences in Virtual Reality. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18), Montreal QC Canada. Paper 328.10.1145/3173574.3173902 ↗
10. Chakrabarti, A., Poovaiah, R., Bokil, P., and Kant, V. (2021). Design for Immersive Experience: Role of Spatial Audio in Extended Reality Applications. Design for Tomorrow—Volume 2, Springer. Smart Innovation, Systems and Technologies.10.1007/978-981-16-0041-8 ↗
11. First-order ambisonic microphones with MEMS and condenser capsules
12. Database of Multichannel In-Ear and Behind-the-Ear Head-Related and Binaural Room Impulse Responses10.1155/2009/298605 ↗
13. Valeria, B., Stefano, N., Alessandro, T., and Stefania, C. (2022). An Improved Approach for Binaural Room Impulse Responses Interpolation in Real Environments [PDF], DII-Università Politecnica delle Marche. Available online: https://aes2.org/publications/elibrary-page/?id=21708.
14. Werner, S., and Liebetrau, J. (2013, January 3–5). Effects of shaping of binaural room impulse responses on localization. Proceedings of the 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX), Klagenfurt am Wörthersee, Austria.10.1109/QoMEX.2013.6603216 ↗
15. Roginska, A., and Geluso, P. (2018). Immersive Sound: The Art and Science of Binaural and Multi-Channel Audio, Routledge. [1st ed.].10.4324/9781315707525 ↗
16. The Role of 3-D Sound in Human Reaction and Performance in Augmented Reality Environments10.1109/TSMCA.2006.886376 ↗
17. Immersive Virtual Environment Technology to Supplement Environmental Perception, Preference and Behavior Research: A Review with Applications10.3390/ijerph120911486 ↗
18. Kronland-Martinet, R., Ystad, S., and Jensen, K. (2008). Experiencing Audio and Music in a Fully Immersive Environment. Computer Music Modeling and Retrieval. Sense of Sounds, Springer. CMMR 2007. Lecture Notes in Computer Science.10.1007/978-3-540-85035-9 ↗
19. Naef, M., Staadt, O., and Gross, M. (2002, January 11–13). Spatialized audio rendering for immersive virtual environments. Proceedings of the ACM Symposium on Virtual Reality Software and Technology (VRST ’02), Hong Kong, China.10.1145/585750.585752 ↗
20. Hong, J.Y., He, J., Lam, B., Gupta, R., and Gan, W.-S. (2017). Spatial Audio for Soundscape Design: Recording and Reproduction. Appl. Sci., 7.10.3390/app7060627 ↗
21. Head-related transfer functions of human subjects
22. MPEG-H 3D Audio—The New Standard for Coding of Immersive Spatial Audio10.1109/JSTSP.2015.2411578 ↗
23. Armstrong, C., Thresh, L., Murphy, D., and Kearney, G. (2018). A Perceptual Evaluation of Individual and Non-Individual HRTFs: A Case Study of the SADIE II Database. Appl. Sci., 8.10.3390/app8112029 ↗
24. Rummukainen, O.S., Robotham, T., and Habets, E.A.P. (2021). Head-Related Transfer Functions for Dynamic Listeners in Virtual Reality. Appl. Sci., 11.10.3390/app11146646 ↗
25. Planinec, V., Reijniers, J., Horvat, M., Peremans, H., and Jambrošić, K. (2023). The Accuracy of Dynamic Sound Source Localization and Recognition Ability of Individual Head-Related Transfer Functions in Binaural Audio Systems with Head Tracking. Appl. Sci., 13.10.3390/app13095254 ↗
26. Hirst, J.M. (2006). Spatial Impression in Multichannel Surround Sound Systems, University of Salford.
27. Romigh, G.D. (2012). Individualized Head-Related Transfer Functions: Efficient Modeling and Estimation from Small Sets of Spatial Samples, School of Electrical and Computer Engineering, Carnegie Mellon University.
28. Multiple exponential sweep method for fast measurement of headrelated transfer functions
29. Spatial audio reproduction by headphones using binaural room impulse responses measured individually by the listener
30. Mi, H., Kearney, G., and Daffern, H. (2022). Impact Thresholds of Parameters of Binaural Room Impulse Responses (BRIRs) on Perceptual Reverberation. Appl. Sci., 12.10.3390/app12062823 ↗
31. Blauert, J. (2001). Spatial Hearing: The Psychophysics of Human Sound Localization, MIT Press.
32. Begault, D. (2001). 3-D Sound For Virtual Reality and Multimedia, Ames Research Center.
33. Kuttruff, H. (2016). Room Acoustics, CRC Press. [6th ed.].10.1201/9781315372150 ↗
34. A parametric model for the synthesis of binaural room impulse responses10.1121/2.0000573 ↗
35. Davis, G., Andre, S., Munoz, I., and Peters, N. (2019, January 27–29). Perceptual Evaluation of Personalized BRIRs and Headphone Compensation. Proceedings of the International AES Conference on Headphone Technology, San Francisco, CA, USA.
36. Qiao, Y., Gonzales, R.M., and Choueiri, E. (2024). A multi-loudspeaker binaural room impulse response dataset with high-resolution translational and rotational head coordinates in a listening room. Front. Signal Process., 4.10.3389/frsip.2024.1380060 ↗
37. Listener Auditory Perception Enhancement using Virtual Sound Source Design for 3D Auditory System10.7236/IJASC.2016.5.4.15 ↗
38. On the Externalization of Auditory Images10.1162/pres.1992.1.2.251 ↗
39. On the externalization of sound sources with headphones without reference to a real source10.1121/1.5128325 ↗
40. Li, S., Schlieper, R., Tobbala, A., and Peissig, J. (2021). The Influence of Binaural Room Impulse Responses on Externalization in Virtual Reality Scenarios. Appl. Sci., 11.10.3390/app112110198 ↗
41. Pörschmann, C., Stade, P., and Arend, J. (2017, January 5–9). Binauralization of Omnidirectional Room Impulse Responses—Algorithm and Technical Evaluation. Proceedings of the 20th International Conference on Digital Audio Effects (DAFx-17), Edinburgh, UK.
42. Koehl, V., Paquier, M., and Delikaris-Manias, S. (2011). Comparison of Subjective Assessments Obtained from Listening Tests through Headphones and Loudspeaker Setups [PDF], National Engineering School of Brest (UEB), University of Brest (UEB). Available online: https://aes2.org/publications/elibrary-page/?id=16086.
43. Hallum, R. (2017). Stereophony—A Series of Perspectives—What Exactly IS Stereo?.
44. Virtual Sound Source Positioning Using Vector Base Amplitude Panning
45. Immersive audio, capture, transport, and rendering: A review
46. All-round ambisonic panning and decoding
47. Heller, A., Benjamin, E., and Lee, R. (2010). Design of Ambisonic Decoders for Irregular Arrays of Loudspeakers by Non-Linear Optimization, Audio Engineering Society.
48. Nagel, S., and Jax, P. (2023, January 20–22). Evaluation of HRTF Models for Binaural Cue Adaptation. Proceedings of the Speech Communication: 15th ITG Conference, Aachen, Germany.
49. Playing with Others Using Headphones: Musicians Prefer Binaural Audio with Head Tracking over Stereo10.1109/THMS.2023.3270703 ↗
50. Bauer, V., Soudoplatoff, D., Menon, L., and Pras, A. (2022). Binaural Headphone Monitoring to Enhance Musicians’ Immersion in Performance. Advances in Fundamental and Applied Research on Spatial Audio, IntechOpen.10.5772/intechopen.104845 ↗
51. Immersive technologies in the formation of musical audio space
52. Pfanzagl-Cardone, E. (2023). The Art and Science of 3D Audio Recording, Springer.10.1007/978-3-031-23046-2 ↗
53. Yan, Z., and Lv, Z. (2020). The Influence of Immersive Virtual Reality Systems on Online Social Application. Appl. Sci., 10.10.3390/app10155058 ↗
54. Designing for human-machine collaboration: Smart hearing aids as wearable technologies10.1145/3188387.3188391 ↗
55. Park, B., Namkung, K., and Pan, Y. (2023). Could You Evaluate Sounds in a Virtual Environment? Evaluation Components of Auditory Experience in a Metaverse Environment. Appl. Sci., 13.10.20944/preprints202309.1005.v1 ↗
56. De Sotgiu, A., Coccoli, M., and Vercelli, G. (2020). Comparing the Perception of ’Sense of Presence’ Between a Stereo Mix and a Binaural Mix in Immersive Music [PDF], DIBRIS, Università degli Studi di Genova. Paper 588.
57. Puomio, O., Pätynen, J., and Lokki, T. (2017). Optimization of Virtual Loudspeakers for Spatial Room Acoustics Reproduction with Headphones. Appl. Sci., 7.10.3390/app7121282 ↗
58. Duarte, F. (2024, October 30). Music Streaming Services Stats (2024). Available online: https://explodingtopics.com/blog/music-streaming-stats.
59. Young, G.W., O’Dwyer, N., Vargas, M.F., Donnell, R.M., and Smolic, A. (2023). Feel the Music!—Audience Experiences of Audio–Tactile Feedback in a Novel Virtual Reality Volumetric Music Video. Arts, 12.10.3390/arts12040156 ↗
60. Sawchuk, A.A., Chew, E., Zimmermann, R., Papadopoulos, C., and Kyriakakis, C. (2003, January 7). From remote media immersion to Distributed Immersive Performance. Proceedings of the 2003 ACM SIGMM workshop on Experiential telepresence (ETP ’03), Berkeley, CA, USA.10.1145/982484.982506 ↗
61. Statisa, and Petroc Taylor (2024, October 30). World Population Coverage by Technology 2012–2029. Available online: https://www.statista.com/statistics/1133353/world-population-coverage-technology/.
62. Nokia (2024, October 30). Nokia Makes World’s First Immersive Voice and Audio Call. Available online: https://www.nokia.com/about-us/news/releases/2024/06/10/nokia-makes-worlds-first-immersive-voice-and-audio-call/.
63. Aguilera, E., López, J.J., Gutierrez, P., and Cobos, M. (2014). An Immersive Multi-Party Conferencing System for Mobile Devices Using Binaural Audio, Audio Engineering Society.
64. The future of hearing aid technology10.1007/s00391-023-02179-y ↗
65. Mansour, N. (2021). Assessing Hearing Device Benefit Using Virtual Sound Environments, DTU Health Technology. Contributions to Hearing Research.
66. Chelladurai, P.K., Li, Z., Weber, M., Oh, T., and Peiris, R.L. (2024, January 27–30). SoundHapticVR: Head-Based Spatial Haptic Feedback for Accessible Sounds in Virtual Reality for Deaf and Hard of Hearing Users. Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’24), St. John’s, NL, Canada. Article 31.10.1145/3663548.3675639 ↗
67. Bruschi, V. (2023). Efficient Algorithms for Immersive Audio Rendering Enhancement. [Doctoral Thesis, Università Politecnica delle Marche]. Available online: https://hdl.handle.net/11566/315269.
68. Mickiewicz, W., and Kosmenda, K. (2023, January 22–25). Spatialization of sound recordings using intensity impulse responses. Proceedings of the 27th International Conference on Methods and Models in Automation and Robotics (MMAR) 2023, Miedzyzdroje, Poland.10.1109/MMAR58394.2023.10242446 ↗