journal article·2020-04-09Open access

Adaptive Speech Separation Based on Beamforming and Frequency Domain-Independent Component Analysis

Ke Zhang, Yangjie Wei, Dan Wu, Yi Wang

Applied Sciences· Volume 10· Issue 7

Abstract

Voice signals acquired by a microphone array often include considerable noise and mutual interference, seriously degrading the accuracy and speed of speech separation. Traditional beamforming is simple to implement, but its source interference suppression is not adequate. In contrast, independent component analysis (ICA) can improve separation, but imposes an iterative and time-consuming process to calculate the separation matrix. As a supporting method, principle component analysis (PCA) contributes to reduce the dimension, retrieve fast results, and disregard false sound sources. Considering the sparsity of frequency components in a mixed signal, we propose an adaptive fast speech separation algorithm based on multiple sound source localization as preprocessing to select between beamforming and frequency domain ICA according to different mixing conditions per frequency bin. First, a fast positioning algorithm allows calculating the maximum number of components per frequency bin of a mixed speech signal to prevent the occurrence of false sound sources. Then, PCA reduces the dimension to adaptively adjust the weight of beamforming and ICA for speech separation. Subsequently, the ICA separation matrix is initialized based on the sound source localization to notably reduce the iteration time and mitigate permutation ambiguity. Simulation and experimental results verify the effectiveness and speedup of the proposed algorithm.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Speech and Audio Processing · Blind Source Separation Techniques · Advanced Adaptive Filtering Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, College of Computer Science and Engineering, Northeastern University, Wenhua Street 3, Shenyang 110819, China

Funding

National Key R&D Program of China · the Natural Science Foundation of China under Grant

References (29)

Show source-provided references
1. Independent component analysis: Algorithms and applications10.1016/S0893-6080(00)00026-5 ↗
2. A new learning algorithm for blind separation of sources
3. Blind Source Separation Combining Independent Component Analysis and Beamforming10.1155/S1110865703305104 ↗
4. Robust adaptive beamforming10.1109/TASSP.1987.1165054 ↗
5. Multiple emitter location and signal parameter estimation10.1109/TAP.1986.1143830 ↗
6. A review of acoustic imaging methods using phased microphone arrays10.1007/s13272-019-00383-4 ↗
7. Speech Enhancement and Recognition in Meetings with an Audio–Visual Sensor Array10.1109/TASL.2007.906197 ↗
8. Niwa, K., Nishino, T., and Takeda, K. (April, January 31). Encoding large array signals into a 3D sound field representation for selective listening point audio based on blind source separation. Proceedings of the 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, Las Vegas, NV, USA.10.1109/ICASSP.2008.4517576 ↗
9. The fundamental limitation of frequency domain blind source separation for convolutive mixtures of speech10.1109/TSA.2003.809193 ↗
10. Assessment of the accuracy of microphone array methods for aeroacoustic measurements10.1016/j.jsv.2020.115176 ↗
11. Permutation inconsistency in blind speech separation: Investigation and solutions10.1109/TSA.2004.834441 ↗
12. A Robust and Precise Method for Solving the Permutation Problem of Frequency-Domain Blind Source Separation10.1109/TSA.2004.832994 ↗
13. Sarradj, E. (March, January 29). A generic approach to synthesize optimal array microphone arrangements. Proceedings of the 6th Berlin Beamforming Conference, Berlin, Germany.
14. Enhanced HR-CLEAN-SC for resolving multiple closely spaced sound sources10.1177/1475472X19852938 ↗
15. Merino-Martinez, R., Herold, G., Snellen, M., and Dougherty, R.P. (2020, January 2–3). Assessment and comparison of the performance of functional projection beamforming for aeroacoustic measurements. Proceedings of the 8th BeBeC (Berlin Beamforming Conference), Berlin, Germany.
16. Convolutive blind source separation for more than two sources in the frequency domain10.1250/ast.25.296 ↗
17. A generalization of blind source separation algorithms for convolutive mixtures based on second-order statistics10.1109/TSA.2004.838775 ↗
18. Fast and robust fixed-point algorithms for independent component analysis10.1109/72.761722 ↗
19. Blind beamforming for non-gaussian signals10.1049/ip-f-2.1993.0054 ↗
20. Three-Dimensional Acoustic Source Mapping with Different Beamforming Steering Vector Formulations
21. Pavlidi, D., Griffin, A., Puigt, M., and Mouchtaris, A. (2012, January 17–20). Source counting in real-time sound source localization using a circular microphone array. Proceedings of the 2012 IEEE 7th Sensor Array and Multichannel Signal Processing Workshop (SAM), Hoboken, NJ, USA.10.1109/SAM.2012.6250555 ↗
22. Real-Time Multiple Sound Source Localization and Counting Using a Circular Microphone Array10.1109/TASL.2013.2272524 ↗
23. Griffin, A., Pavlidi, D., Puigt, M., and Mouchtaris, A. (2012, January 27–31). Real-time multiple speaker DOA estimation in a circular microphone array based on Matching Pursuit. Proceedings of the 20th European Signal Processing Conference (EUSIPCO), Bucharest, Romania.
24. Blind Separation of Speech Mixtures via Time-Frequency Masking10.1109/TSP.2004.828896 ↗
25. Puigt, M., and Deville, Y. (2017, January 21–23). A New Time-Frequency Correlation-Based Source Separation Method for Attenuated and Time Shifted Mixtures. Proceedings of the 8 th International Workshop on Electronics, Control, Modelling, Measurement and Signals, Liberec, Czech Republic.
26. Speaker localization in noisy environments using steered response voice power10.1109/TCE.2015.7064118 ↗
27. Capturing and Reproducing Spatial Audio Based on a Circular Microphone Array
28. Diffuse Reverberation Model for Efficient Image-Source Simulation of Room Impulse Responses10.1109/TASL.2009.2035038 ↗
29. (2018, October 12). Available online: http://www.eric-lehmann.com/.