Three-Dimensional Sound Field Reconstruction and Sound Power Estimation by Stereo Vision and Beamforming Technology
Source abstract
Abstract
The size of the sound field reconstruction area has an important influence on the beamforming sound source localization method and determines the speed of reconstruction. To reduce the sound field reconstruction area, stereo vision technology is introduced to continuously obtain the three-dimensional surface of the target and reconstruct the sound field on it. The fusion method can quickly locate the three-dimensional position of the sound source, and the computational complexity of this method is mathematically analyzed. The sound power level can be estimated dynamically by the sound intensity scaling method based on beamforming and the depth information of the sound source. Experimental results in a hemi-anechoic chamber show that this method can quickly identify the three-dimensional position of the moving source. When the depth of the moving sound source changes, the estimated sound power is more stable than the sound pressure on the microphone.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Aerodynamics and Acoustics in Jet Flows · Acoustic Wave Phenomena Research · Speech and Audio Processing
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Mechanical and Electrical Engineering, Kunming University of Science and Technology, Kunming 650500, China
College of Mathematics and Physics, Southwest Forestry University, Kunming 650224, China
Yunnan Vocational College of Mechanical and Electrical Technology, Kunming 650203, China
Funding
National Natural Science Foundation of China · Science and Technology Major Project of Yunnan Province
References (25)
Show source-provided references
1. Cross power spectral density based beamforming for underwater acoustic communications10.1016/j.oceaneng.2020.107786 ↗
2. Channel parameter estimation for millimeter-wave cellular systems with hybrid beamforming10.1016/j.sigpro.2020.107715 ↗
3. Coherence-based beamforming increases the diagnostic certainty of distinguishing fluid from solid masses in breast ultrasound exams10.1016/j.ultrasmedbio.2020.01.016 ↗
4. Michel, U. (2006, January 22–23). History of acoustic beamforming. Proceedings of the 1st Berlin Beamforming Conference, Berlin, Germany.
5. Acoustic beamforming for noise source localization—Reviews, methodology and applications10.1016/j.ymssp.2018.09.019 ↗
6. Functional beamforming applied to imaging of flyover noise on landing aircraft10.2514/1.C033691 ↗
7. Experiences with various configurations of microphone arrays used to locate sound sources on railway trains operated by the DB AG10.1006/jsvi.1996.0269 ↗
8. Application of acoustic imaging techniques on snowmobile pass-by noise10.1121/1.4976138 ↗
9. Beamforming
10. Döbler, D., Ocker, J., and Puhle, C. (March, January 29). On 3D-beamforming in the wind tunnel. Proceedings of the 6th Berlin Beamforming Conference, Berlin, Germany.
11. Automatic 3D scanning surface generation for microphone array acoustic imaging10.1016/j.apacoust.2013.08.008 ↗
12. Bub, U., Hunke, M., and Waibel, A. (1995, January 9–12). Knowing who to listen to in speech recognition: visually guided beamforming. Proceedings of the 1995 International Conference on Acoustics, Speech, and Signal Processing, Washington, DC, USA.
13. Best, V., Roverud, E., Streeter, T., Mason, C.R., and Kidd, G. (2017). The benefit of a visually guided beamformer in a dynamic speech task. Trends Hear., 21.10.1177/2331216517722304 ↗
14. A visually guided beamformer to aid listening in complex acoustic environments10.1121/2.0000972 ↗
15. Novoa, J., Mahu, R., Díaz, A., Wuth, J., Stern, R., and Yoma, N.B. (2019). Weighted delay-and-sum beamforming guided by visual tracking for human-robot interaction. arXiv.
16. Donovan, A.O., Duraiswami, R., and Zotkin, D. (April, January 31). Imaging concert hall acoustics using visual and audio cameras. Proceedings of the 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, Hannover, Germany.10.1109/ICASSP.2008.4518852 ↗
17. Three-dimensional microscopic surgical videos: A novel and low-cost system10.1016/j.wneu.2019.08.139 ↗
18. Fast spatial–temporal stereo matching for 3D face reconstruction under speckle pattern projection10.1016/j.imavis.2019.02.007 ↗
19. Experimental validation of determining sound power using acoustic radiation modes and a laser vibrometer10.1016/j.apacoust.2020.107254 ↗
20. Effects of a finite size reflecting disk in sound power measurements10.1016/j.apacoust.2018.05.007 ↗
21. Hald, J. (2005, January 7–10). Estimation of partial area sound power data with beamforming. Proceedings of the 2005 Congress and Exposition on Noise Control Engineering, Rio de Janeiro, Brazil.
22. Displacement monitoring for slope stability evaluation based on binocular vision systems10.1016/j.ijleo.2018.06.097 ↗
23. Liu, S., Gao, D., Wang, P., Guo, X., Xu, J., and Liu, D.-X. (2018). A depth-based weighted point cloud registration for indoor scene. Sensors, 18.10.3390/s18113608 ↗
24. Rotational-symmetry in a 3D scene and its 2D image10.1016/j.jmp.2018.10.001 ↗
25. Faires, J.D., and Burden, R.L. (2004). Numerical Analysis, Brooks Cole.