journal article·2020-01-22Open access

Interaural Coherence Estimation for Speech Processing in Reverberant Environment

Seong-Hu Kim, Yong-Hwa Park

Applied Sciences· Volume 10· Issue 3

Abstract

Interaural coherence is used to quantify the effects of reverberation on speech, and previous studies applied the conventional method using all previous time data in the form of an infinite impulse response filter to estimate interaural coherence. To consider a characteristic of speech that continuously changes over time, this paper proposes a new method of estimating interaural coherence using time data within a finite length of speech, which is called the quasi-steady interval. The length of the quasi-steady interval is determined with various frequency bands, reverberation times, and short-time Fourier transform (STFT) variables through numerical experiment, and it decreased as reverberation time decreased and the frequency increased. In this interval, a diffuse speech, which is an infinite sum of reflected speeches of different propagating paths, is uncorrelated between two microphones apart from each other; thus, the coherence is close to zero. However, a direct speech measured at the two microphones has steady amplitude and phase difference in this internal; thus, the coherence is close to one. Moreover, the new method is the form of a finite impulse response filter that has a linear phase delay or zero phase delay with respect to speech to frequency; thus, the same or zero time delay for each frequency is applied to the power spectral density. Therefore, the coherence estimation of the new method is closer to the ideal value than the conventional one, and the coherence is accurately estimated at the time–frequency bins of direct speech, which is time-varying according to speech variation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Speech and Audio Processing · Acoustic Wave Phenomena Research · Ultrasonics and Acoustic Wave Propagation

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Korea

References (18)

Show source-provided references
1. An analysis of environment, microphone and data simulation mismatches in robust speech recognition10.1016/j.csl.2016.11.005 ↗
2. Jourjine, A., Rickard, S., and Yilmaz, O. (2000, January 5–9). Blind separation of disjoint orthogonal signals: Demixing N sources from 2 mixtures. Proceedings of the 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing, Istanbul, Turkey. Proceedings (Cat. No. 00CH37100).
3. Model-based expectation-maximization source separation and localization10.1109/TASL.2009.2029711 ↗
4. Zurek, P.M. (1987). The Precedence Effect. Directional Hearing, Springer.10.1007/978-1-4612-4738-8_4 ↗
5. The precedence effect10.1121/1.427914 ↗
6. Wang, D., and Brown, G.J. (2006). Computational Auditory Scene Analysis: Principles, Algorithms, and Applications, Wiley-IEEE Press.
7. The coherence of reverberant sound fields10.1121/1.429457 ↗
8. Kuttruff, H. (2016). Room Acoustics, Crc Press.10.1201/9781315372150 ↗
9. Source localization in complex listening situations: Selection of binaural cues based on interaural coherence10.1121/1.1791872 ↗
10. Alinaghi, A., Wang, W., and Jackson, P.J. (2013, January 26–31). Spatial and coherence cues based time-frequency masking for binaural reverberant speech separation. Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, Vancouver, BC, Canada.10.1109/ICASSP.2013.6637735 ↗
11. Model-based dereverberation preserving binaural cues10.1109/TASL.2010.2052156 ↗
12. Jeub, M., and Vary, P. (2010, January 14–19). Binaural dereverberation based on a dual-channel wiener filter with optimized noise field coherence. Proceedings of the 2010 IEEE International Conference on Acoustics, Speech and Signal Processing, Dallas, TX, USA.10.1109/ICASSP.2010.5495179 ↗
13. Schwarz, A., Brendel, A., and Kellermann, W. (2014). Coherence-based dereverberation for automatic speech recognition. Processings DAGA, Citeseer.
14. The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms10.1109/TAU.1967.1161901 ↗
15. Image method for efficiently simulating small-room acoustics10.1121/1.382599 ↗
16. Garofolo, J.S., Lamel, L.F., Fisher, W.M., Fiscus, J.G., and Pallett, D.S. (1993). DARPA TIMIT acoustic-phonetic continous speech corpus CD-ROM. NIST speech disc 1-1.1. NASA STI/Recon Tech. Rep. N, 93.10.6028/NIST.IR.4930 ↗
17. Jeub, M., Schafer, M., and Vary, P. (2009, January 5–7). A binaural room impulse response database for the evaluation of dereverberation algorithms. Proceedings of the 2009 16th International Conference on Digital Signal Processing, Santorini, Greece.10.1109/ICDSP.2009.5201259 ↗
18. Rix, A.W., Beerends, J.G., Hollier, M.P., and Hekstra, A.P. (2001, January 7–11). Perceptual evaluation of speech quality (PESQ)-a new method for speech quality assessment of telephone networks and codecs. Proceedings of the 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing, Salt Lake City, UT, USA. Proceedings (Cat. No. 01CH37221).