journal article·2021Open access

Microphone Array Speech Separation Algorithm Based on TC-ResNet

Lin Zhou, Yue Xu, Tianyi Wang, Kun Feng, Jingang Shi

Computers, Materials & Continua· Volume 69· Issue 2

Abstract

Traditional separation methods have limited ability to handle the speech separation problem in high reverberant and low signal-to-noise ratio (SNR) environments, and thus achieve unsatisfactory results. In this study, a convolutional neural network with temporal convolution and residual network (TC-ResNet) is proposed to realize speech separation in a complex acoustic environment. A simplified steered-response power phase transform, denoted as GSRP-PHAT, is employed to reduce the computational cost. The extracted features are reshaped to a special tensor as the system inputs and implements temporal convolution, which not only enlarges the receptive field of the convolution layer but also significantly reduces the network computational cost. Residual blocks are used to combine multiresolution features and accelerate the training procedure. A modified ideal ratio mask is applied as the training target. Simulation results demonstrate that the proposed microphone array speech separation algorithm based on TC-ResNet achieves a better performance in terms of distortion ratio, source-to-interference ratio, and short-time objective intelligibility in low SNR and high reverberant environments, particularly in untrained situations. This indicates that the proposed method has generalization to untrained conditions.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Speech and Audio Processing · Advanced Adaptive Filtering Techniques · Music and Audio Processing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (23)

Show source-provided references
1. Noise cancellation based on voice activity detection using spectral variation for speech recognition in smart home devices
2. Multi-channel speech processing architectures for noise robust speech recognition: 3rd chime challenge results
3. Boosting classification based speech separation using temporal dynamics
4. Binaural speech separation algorithm based on long and short time memory networks10.32604/cmc.2020.010182 ↗
5. Generalized array architecture with multiple sub-arrays and hole-repair algorithm for doa estimation10.32604/cmc.2020.09964 ↗
6. The generalized correlation method for estimation of time delay10.1109/TASSP.1976.1162830 ↗
7. Sound source localization based on srp-phat spatial spectrum and deep neural network10.32604/cmc.2020.09848 ↗
8. Performance of real-time source-location estimators for a large-aperture microphone array10.1109/TSA.2005.848875 ↗
9. A linear closed-form algorithm for source localization from time-differences of arrival10.1109/LSP.2007.910324 ↗
10. M. Kolbæk, D. Yu, Z. Tan and J. Jensen, “Multitalker speech separation with utterance-level permutation invariant training of deep recurrent neural networks,” IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 25, no. 10, pp. 1901–1913, 2017.10.1109/TASLP.2017.2726762 ↗
11. Conv-tasNet: Surpassing ideal time–Frequency magnitude masking for speech separation10.1109/TASLP.2019.2915167 ↗
12. Enhancing end-to-end multi-channel speech separation via spatial feature learning
13. Ultratrail: A configurable ultra-low power TC-resNet AI accelerator for efficient keyword spotting10.1109/TCAD.2020.3012320 ↗
14. Temporal convolution for real-time keyword spotting on mobile devices
15. Mixed noise removal by residual learning of deep cnn10.32604/jnm.2020.09356 ↗
16. Online deep attractor network for real-time single-channel speech separation
17. SDR–half-baked or well done?
18. Oracle performance investigation of the ideal masks
19. Yin · Advancement of Artificial Intelligence · 2020 · 9458
20. Firoozabadi · Signal Processing: Algorithms, Architectures, Arrangements, and Applications, · 2019 · 208
21. Filterbank design for End-to-end speech separation
22. 2D beamforming on sparse arrays with sparse Bayesian learning
23. Image method for efficiently simulating small-room acoustics10.1121/1.382599 ↗