A Speech Preprocessing Method Based on Perceptually Optimized Envelope Processing to Increase Intelligibility in Reverberant Environments
Source abstract
Abstract
Speech intelligibility in public places can be degraded by the environmental noise and reverberation. In this study, a new near-end listening enhancement (NELE) approach is proposed in which using a time varying filter jointly enhances the onsets and reduces the overlap masking. For optimization, some look-ahead in clean speech and prior knowledge of room impulse response (RIR) are required. In this method, by optimizing a defined cost function, the Spectro-Temporal Envelope of reverb speech is optimized to be as close as possible to that of clean speech. In this cost function, onsets of speech are optimized with increased weight. This approach is different from overlap-masking ratio (OMR) and speech enhancement (OE) approaches (Grosse, van de Par, 2017, J. Audio Eng. Soc., Vol. 65 (1/2), pp. 31–41) that only consider previous frames in each time slot for determining the time variant filtering. The SRT measurements show that the new optimization framework enhances the speech intelligibility up to 2 dB more that OE.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Speech and Audio Processing · Hearing Loss and Rehabilitation · Advanced Adaptive Filtering Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Acoustics Group, Cluster of Excellence—Hearing4all, Carl von Ossietzky University of Oldenburg, 26129 Oldenburg, Germany
Funding
Deutsche Forschungsgemeinschaft
References (30)
Show source-provided references
1. Sauert, B., and Vary, P. (2006, January 14–19). Near end listening enhancement: Speech intelligibility improvement in noisy environments. Proceedings of the 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings, Toulouse, France.
2. Near and far field speech-in-noise intelligibility improvements based on a time–frequency energy reallocation approach10.1109/TASLP.2016.2585864 ↗
3. Zorila, T.-C., Kandia, V., and Stylianou, Y. (2012, January 9–13). Speech-in-noise intelligibility improvement based on spectral shaping and dynamic range compression. Proceedings of the Thirteenth Annual Conference of the International Speech Communication Association, Portland, OR, USA.10.21437/Interspeech.2012-197 ↗
4. Recognition of natural and time/intensity altered CVs by young and elderly subjects with normal hearing10.1121/1.394324 ↗
5. Chermaz, C., and King, S. (2020, January 25–29). A sound engineering approach to near end listening enhancement. Proceedings of the Interspeech, Shanghai, China.10.21437/Interspeech.2020-2748 ↗
6. Speech-in-noise enhancement using amplification and dynamic range compression controlled by the speech intelligibility index10.1121/1.4932168 ↗
7. Schepker, H., Hülsmeier, D., Rennies, J., and Doclo, S. (2015, January 6–10). Model-based integration of reverberation for noise-adaptive near-end listening enhancement. Proceedings of the Sixteenth Annual Conference of the International Speech Communication Association, Resden, Germany.10.21437/Interspeech.2015-30 ↗
8. Chermaz, C., Valentini-Botinhao, C., Schepker, H.F., and King, S. (2019, January 15–19). Evaluating Near End Listening Enhancement Algorithms in Realistic Environments. Proceedings of the INTERSPEECH, Graz, Austria.10.21437/Interspeech.2019-1800 ↗
9. Speech energy redistribution for intelligibility improvement in noise based on a perceptual distortion measure10.1016/j.csl.2013.11.003 ↗
10. Li, H., Fu, S.-W., Tsao, Y., and Yamagishi, J. (2020). iMetricGAN: Intelligibility Enhancement for Speech-in-Noise using Generative Adversarial Network-based Metric Learning. arXiv.10.21437/Interspeech.2020-1016 ↗
11. Schädler, M. (2020, January 25–29). Optimization and evaluation of an intelligibilityimproving signal processing approach (IISPA) for the Hurricane Challenge 2.0 with FADE. Proceedings of the Interspeech, Shanghai, China.10.21437/Interspeech.2020-93 ↗
12. Room impulse response shortening/reshaping with infinity-and $ p $-norm optimization10.1109/TASL.2009.2025789 ↗
13. Modulation enhancement of speech by a pre-processing algorithm for improving intelligibility in reverberant environments10.1016/j.specom.2004.06.003 ↗
14. Using steady-state suppression to improve speech intelligibility in reverberant environments for elderly listeners10.1109/TASL.2010.2052165 ↗
15. Adaptive gain control for enhanced speech intelligibility under reverberation10.1109/LSP.2016.2598807 ↗
16. A speech preprocessing method based on overlap-masking reduction to increase intelligibility in reverberant environments10.17743/jaes.2016.0067 ↗
17. Effects of suppressing steady-state portions of speech on intelligibility in reverberant environments10.1250/ast.23.229 ↗
18. Improving syllable identification by a preprocessing method reducing overlap-masking in reverberant environments10.1121/1.2198191 ↗
19. An algorithm for intelligibility prediction of time–frequency weighted noisy speech10.1109/TASL.2011.2114881 ↗
20. Masri, P., and Bateman, A. (1996, January 19–24). Imroved Modelling of Attack Transients in Music Analysis-Resynthesis. Proceedings of the ICMC, Hong Kong.
21. Collins, N. (2005, January 28–31). A comparison of sound onset detection algorithms with emphasis on psychoacoustically motivated detection functions. Proceedings of the Audio Engineering Society Convention 118, Barcelona, Spain.
22. Nocedal, J., and Wright, S. (2006). Numerical Optimization, Springer Science & Business Media.
23. Fletcher, R. (2013). Practical Methods of Optimization, John Wiley & Sons.
24. Development and evaluation of a German sentence test part III: Evaluation of the Oldenburg sentence test
25. Benchmark for Room Acoustical Simulation (BRAS)
26. The role of short-time intensity and envelope power for speech intelligibility and psychoacoustic masking10.1121/1.4999059 ↗
27. Ewert, S.D. (2013, January 18–21). AFC—A modular framework for running psychoacoustic experiments and computational perception models. Proceedings of the international conference on acoustics AIA-DAGA, Merano, Italy.
28. Van De Par, S., Kot, V., and Van Schijndel, N. (2005). Scalable noise coder for parametric sound coding. Audio Engineering Society 118, Audio Engineering Society.
29. Rennies, J., Schepker, H., Valentini-Botinhao, C., and Cooke, M. (2020, January 25–29). Intelligibility-enhancing speech modifications–the hurricane challenge 2.0. Proceedings of the 2020 Interspeech, Shanghai, China.10.21437/Interspeech.2020-1641 ↗
30. Bederna, F., Schepker, H., Rollwage, C., Doclo, S., Pusch, A., Bitzer, J., and Rennies, J. (2020, January 25–29). Adaptive compressive onset-enhancement for improved speech intelligibility in noise and reverberation. Proceedings of the Interspeech, Shanghai, China.10.21437/Interspeech.2020-2640 ↗