3-D Sound Image Reproduction Method Based on Spherical Harmonic Expansion for 22.2 Multichannel Audio
Source abstract
Abstract
In this paper, we propose a three-dimensional (3-D) sound image reproduction method based on spherical harmonic (SH) expansion for 22.2 multichannel audio. 22.2 multichannel audio is a 3-D sound field reproduction system that has been developed for ultra-high definition television (UHDTV). This system can reproduce 3-D sound images by simultaneously driving 22 loudspeakers and two sub-woofers. To control the 3-D sound image, vector base amplitude panning (VBAP) is conventionally used. VBAP can control the direction of 3-D sound image by weighting the input signal and emitting it from three loudspeakers. However, VBAP cannot control the distance of the 3-D sound image because it calculates the weight by only considering the image’s direction. To solve this problem, we propose a novel 3-D sound image reconstruction method based on SH expansion. The proposed method can control both the direction and distance of the 3-D sound image by controlling the sound directivity on the basis of spherical harmonics (SHs) and mode matching. The directivity of the 3-D sound image is obtained in the SH domain. In addition, the distance of the 3-D sound image is represented by the mode strength. The signal obtained by the proposed method is then emitted from loudspeakers and the 3-D sound image can be reproduced accurately with consideration of not only the direction but also the distance. A number of experimental results show that the proposed method can control both the direction and distance of 3-D sound images.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Speech and Audio Processing · Hearing Loss and Rehabilitation · Advanced Adaptive Filtering Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Information Science and Engineering, Ritsumeikan University, Kusatsu 525-8577, Japan
Funding
Japan Society for the Promotion of Science
References (25)
Show source-provided references
1. Roginska, A., and Geluso, P. (2017). Immersive Sound: The Art and Science of Binaural and Multi-Channel Audio, Routledge. [1st ed.].10.4324/9781315707525 ↗
2. Interactive directivity control using dodecahedron loudspeaker array10.2299/jsp.20.209 ↗
3. Okamoto, T. (2021, January 18–21). 2D multizone sound field systhesis with interior-exterior Ambisonics. Proceedings of the 2021 IEEE Workshop Applications of Signal Processing to Audio and Acoustics, Virtual Event.10.1109/WASPAA52581.2021.9632736 ↗
4. A 22.2 Multichannel Sound System for Ultrahigh-Definition TV (UHDTV)10.5594/J15119 ↗
5. Institutional Telecommunication Union Radiocommunication Sector (ITU-R) Recommendation BS. 2051-2 (2018). Advanced Sound System for Programme Production, Available online: https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&cad=rja&uact=8&ved=2ahUKEwiIuf-D8_71AhU363MBHQs-CSoQFnoECAMQAQ&url=https%3A%2F%2Fwww.itu.int%2Fdms_pubrec%2Fitu-r%2Frec%2Fbs%2FR-REC-BS.2051-2-201807-I!!PDF-E.pdf&usg=AOvVaw07oyUacd5OYXmikUvzCfj2.
6. Approach to recreating a sound field10.1121/1.1911002 ↗
7. Acoustic control by wave field synthesis10.1121/1.405852 ↗
8. Sound field reproduction and sharing system based on the boundary surface control principle10.1250/ast.36.1 ↗
9. Institutional Telecommunication Union Radiocommunication Sector (ITU-R) Recommendation BS.775-2 (2006). Multichannel Stereophonic Sound System with and without Accompanying Picture, Available online: https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwiYg_y58_71AhXY5nMBHeGGBtEQFnoECAUQAQ&url=https%3A%2F%2Fwww.itu.int%2Fdms_pub%2Fitu-r%2Fopb%2Frec%2FR-REC-LS-2007-E02-PDF-E.pdf&usg=AOvVaw3YzFGDUR8es0kBuKwOa9m6.
10. Rumsey, F. (2001). Spatial Audio, Focal Press.
11. Virtual Sound Source Positioning Using Vector Base Amplitude Panning
12. Ando, A., and Hamasaki, K. (2009, January 7–10). Sound intensity based three-dimensional panning. Proceedings of the Audio Engineering Society 126th Convention, Munich, Germany.
13. Suzuki, H., Iwai, K., and Nishiura, T. (2020, January 23–26). 3-D sound image panning based on spherical harmonics expansion for 22.2 multichannel audio. Proceedings of the INTER-NOISE 2020, E-Congress, Seoul, Korea.
14. Meyer, J., and Elko, G. (2002, January 13–17). A highly scalable spherical microphone array based on an orthonormal decomposition of the soundfield. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2002), Orlando, FL, USA.10.1109/ICASSP.2002.1006109 ↗
15. Müller, C. (2006). Spherical Harmonics, Springer.
16. Multiple emitter location and signal parameter estimation10.1109/TAP.1986.1143830 ↗
17. Williams, E. (1999). Fourier Acoustics: Sound Radiation and Nearfield Acoustical Holography, Springer.10.1016/B978-012753960-7/50007-3 ↗
18. Frequency domain binaural model based on interaural phase and level differences10.1250/ast.24.172 ↗
19. Sound field reproduction and sharing system based on the boundary surface control principle10.1121/1.1610463 ↗
20. Algazi, V.R., Duda, R.O., Thompson, D.M., and Avendano, C. (2001, January 21–24). The CIPIC HRTF Database. Proceedings of the IEEE Workshop Applications of Signal Processing to Audio and Electroacoustics, Mohonk Mountain House, New Paltz, NY, USA.
21. Woodworth, R. (1938). Experimental Psychology, Holt, Rinehart and Winston.
22. Zheng, K., Otsuka, M., and Nishiura, T. (2019, January 9–13). 3-D Sound image localization in reproduction of 22.2 multichannel audio based on room impulse response generation with vector composition. Proceedings of the International Congress on Acoustics (ICA 2019), Aachen, Germany.
23. Trees, H.L.V. (2002). Optimum Array Processing, Wiley.
24. Johnson, D.H., and Dudgeon, D.E. (1993). Array Signal Processing, Prentice Hall.
25. Omologo, M., and Svaizer, P. (1994, January 19–22). Acoustic event localization using a crosspower-spectrum phase based technique. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 1994), Adelaide, SA, Australia.