Analyzing the Influence of Diverse Background Noises on Voice Transmission: A Deep Learning Approach to Noise Suppression
Source abstract
Abstract
This paper presents an approach to enhancing the clarity and intelligibility of speech in digital communications compromised by various background noises. Utilizing deep learning techniques, specifically a Variational Autoencoder (VAE) with 2D convolutional filters, we aim to suppress background noise in audio signals. Our method focuses on four simulated environmental noise scenarios: storms, wind, traffic, and aircraft. The training dataset has been obtained from public sources (TED-LIUM 3 dataset, which includes audio recordings from the popular TED-TALK series) combined with these background noises. The audio signals were transformed into 2D power spectrograms, upon which our VAE model was trained to filter out the noise and reconstruct clean audio. Our results demonstrate that the model outperforms existing state-of-the-art solutions in noise suppression. Although differences in noise types were observed, it was challenging to definitively conclude which background noise most adversely affects speech quality. The results have been assessed with objective (mathematical metrics) and subjective (listening to a set of audios by humans) methods. Notably, wind noise showed the smallest deviation between the noisy and cleaned audio, perceived subjectively as the most improved scenario. Future work should involve refining the phase calculation of the cleaned audio and creating a more balanced dataset to minimize differences in audio quality across scenarios. Additionally, practical applications of the model in real-time streaming audio are envisaged. This research contributes significantly to the field of audio signal processing by offering a deep learning solution tailored to various noise conditions, enhancing digital communication quality.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Speech and Audio Processing · Acoustic Wave Phenomena Research · Noise Effects and Management
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
CEIEC, Universidad Francisco de Vitoria, Ctra. Pozuelo-Majadahonda km. 1800, 28223 Madrid, Spain
References (39)
Show source-provided references
1. Zhang, H., and Wang, D. (September, January 30). A Deep Learning Approach to Multi-Channel and Multi-Microphone Acoustic Echo Cancellation. Proceedings of the Interspeech 2021, Brno, Czech Republic.10.21437/Interspeech.2021-1508 ↗
2. Proximal normalized subband adaptive filtering for acoustic echo cancellation10.1109/TASLP.2021.3087951 ↗
3. Overview of image denoising based on deep learning10.1088/1742-6596/1176/2/022010 ↗
4. Bioacoustic signal denoising: A review10.1007/s10462-020-09932-4 ↗
5. Deep learning10.1038/nature14539 ↗
6. Speech Enhancement Using Deep Learning Methods: A Review10.14203/jet.v21.19-26 ↗
7. Blind separation of audio signals using trigonometric transforms and wavelet denoising10.1007/s10772-010-9066-0 ↗
8. Audio denoising by time-frequency block thresholding10.1109/TSP.2007.912893 ↗
9. Yu, G., Bacry, E., and Mallat, S. (2007, January 15–20). Audio signal denoising with complex wavelets and adaptive block attenuation. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing-ICASSP’07 2007, Honolulu, HI, USA.10.1109/ICASSP.2007.366818 ↗
10. Ng, L.C., Burnett, G.C., Holzrichter, J.F., and Gable, T.J. (2000, January 5–9). Denoising of human speech using combined acoustic and EM sensor signal processing. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Proceedings (Cat. No. 00CH37100), Istanbul, Turkey.
11. Deep learning based real-time speech enhancement for dual-microphone mobile phones10.1109/TASLP.2021.3082318 ↗
12. A deep learning framework for audio restoration using Convolutional/Deconvolutional Deep Autoencoders10.1016/j.eswa.2023.120586 ↗
13. Pascual, S., Bonafonte, A., and Serra, J. (2017). SEGAN: Speech enhancement generative adversarial network. arXiv.10.21437/Interspeech.2017-1428 ↗
14. Signal speech reconstruction and noise removal using convolutional denoising audioencoders with neural deep learning10.1007/s10470-019-01446-6 ↗
15. Speech enhancement with noise estimation and filtration using deep learning models10.1016/j.tcs.2022.08.017 ↗
16. Deep learning models for single-channel speech enhancement on drones10.1109/ACCESS.2023.3253719 ↗
17. Shi, H., Shu, Y., Wang, L., Dang, J., and Kawahara, T. (2022, January 7–10). Fusing multiple bandwidth spectrograms for improving speech enhancement. Proceedings of the Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Chiang Mai, Thailand.10.23919/APSIPAASC55919.2022.9980180 ↗
18. On cross-corpus generalization of deep learning-based speech enhancement10.1109/TASLP.2020.3016487 ↗
19. Roy, S.K., Nicolson, A., and Paliwal, K.K. (2020, January 25–29). A Deep Learning-Based Kalman Filter for Speech Enhancement. Proceedings of the Interspeech 2020, Shanghai, China.10.21437/Interspeech.2020-1551 ↗
20. An experimental analysis of deep learning architectures for supervised speech enhancement10.3390/electronics10010017 ↗
21. Luo, H., Lu, S., Wei, Q., Fu, Y., and Tian, J. (2022, January 20–23). Spectrogram-based speech enhancement by spatial attention generative adversarial networks. Proceedings of the 14th International Conference on Digital Image Processing (ICDIP 2022), Wuhan, China.10.1117/12.2644385 ↗
22. Measuring the impact of audio compression on the spectral quality of speech data
23. Evaluation of Sound Quality of High Resolution Audio
24. (2023, November 26). Sourceforge SoX-Sound. Available online: http://sox.sourceforge.net/.
25. A CNN-based end-to-end learning framework toward intelligent communication systems10.1109/ACCESS.2019.2926843 ↗
26. Precision prediction of the log power spectrum10.1093/mnrasl/slw178 ↗
27. McFee, B., Raffel, C., Liang, D., Ellis, D.P., McVicar, M., Battenberg, E., and Nieto, O. (2015, January 6–12). librosa: Audio and music signal analysis in python. Proceedings of the 14th Python in Science Conference, Austin, TX, USA.10.25080/Majora-7b98e3ed-003 ↗
28. LeCun, Y., Boser, B., Denker, J., Henderson, D., Howard, R., Hubbard, W., and Jackel, L. (1989). Handwritten digit recognition with a back-propagation network. Adv. Neural Inf. Process. Syst., 2.
29. LeCun, Y., Haffner, P., Bottou, L., and Bengio, Y. (1999). Shape, Contour and Grouping in Computer Vision, Lecture Notes in Computer Science; Springer.
30. Reducing the dimensionality of data with neural networks10.1126/science.1127647 ↗
31. Kingma, D.P., and Welling, M. (2013). Auto-encoding variational bayes. arXiv.
32. Bergstra, J.S., Bardenet, R., Bengio, Y., and K’egl, B. (2011). Advances in Neural Information Processing Systems, NIPS.
33. Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv.
34. Enhancement and bandwidth compression of noisy speech10.1109/PROC.1979.11540 ↗
35. Narayanaswamy, V.S., Thiagarajan, J.J., and Spanias, A. (2021). On the Design of Deep Priors for Unsupervised Audio Restoration. arXiv.10.21437/Interspeech.2021-1890 ↗
36. Sammut, C., and Webb, G.I. (2011). Encyclopedia of Machine Learning, Springer Science & Business Media.10.1007/978-0-387-30164-8 ↗
37. Signal-to-noise ratio (SNR) as a measure of reproducibility: Design, estimation, and application10.1007/s10742-008-0030-2 ↗
38. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
39. (2023, December 12). Scikit-Image Library. Available online: https://scikit-image.org/.