Multimode Tree-Coding of Speech with Pre-/Post-Weighting
Source abstract
Abstract
As speech-coding standards have improved over the years, so complexity has increased, and less emphasis been placed on low encoding/decoding delay. We present a low-complexity, low-delay speech codec based on tree-coding with sample-by-sample adaptive long- and short-code generators that incorporates pre- and post-filtering for perceptual weighting and multimode speech classification with comfort noise generation (CNG). The pre-/post-weighting filters adapt based on the code generator parameters available at both the encoder and decoder rather than the usual method that uses the input speech. The coding of the multiple speech modes and comfort noise generation is accomplished using the code generator adaptation algorithms, again, rather than using the input speech. Codec complexity comparisons are presented and operational rate distortion curves for several standardized speech codecs and the new codec are given. Finally, codec performance is shown in relation to theoretical rate distortion bounds.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Data Compression Techniques · Speech and Audio Processing · Speech Recognition and Synthesis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
MediaTek Inc., No. 1, Dusing 1st Road, Hsinchu Science Park, Hsinchu City 30078, Taiwan
Qualcomm, Inc., 5775 Morehouse Drive, San Diego, CA 92121, USA
Department of Electrical and Computer Engineering, University of California, Santa Barbara, CA 93106, USA
References (47)
Show source-provided references
1. Adaptive predictive coding of speech signals10.1002/j.1538-7305.1970.tb04297.x ↗
2. Jayant, N.S., and Noll, P. (1984). Digital Coding of Waveforms: Principles and Applications to Speech and Video, Prentice Hall.10.1016/0165-1684(85)90053-2 ↗
3. Li, Y.-Y., and Gibson, J.D. (2012, January 4–7). Multimode Tree Coding of Speech with Backward Pitch Prediction and Perceptual Pre- and Post-weighting. Proceedings of the the 46th Annual Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, CA, USA.10.1109/ACSSC.2012.6488963 ↗
4. (2001). Perceptual Evaluation of Speech Quality (PESQ), an Objective Method for End-to-End Speech Quality Assessment of Narrow-Band Telephone Networks and Speech Codecs (Standard No. ITU-T Recommendation P.862).
5. Rate distortion bounds for voice and video10.1561/0100000061 ↗
6. Gibson, J.D. (2012). Speech Coding for Wireless Communications. Mobile Communications Handbook, CRC Press.
7. Gibson, J.D. (2016). Speech compression. Information, 7.10.3390/info7020032 ↗
8. (2007). Coding of Speech at 8 kbit/s Using Conjugate-Structure Algebraic-Code-Excited Linear Prediction (CS-ACELP) (Standard No. ITU-T Recommendation G.729).
9. 3GPP (2011). Mandatory Speech Codec Speech Processing Functions; Adaptive Multi-Rate (AMR) Speech Codec; Transcoding Functions, 3rd Generation Partnership Project (3GPP). TS 26.090.
10. 3GPP (2011). Speech Codec Speech Processing Functions; Adaptive Multi-Rate-Wideband (AMR-WB) Speech Codec; Transcoding Functions, 3rd Generation Partnership Project (3GPP). TS 26.190.
11. Dietz, M., Multrus, M., Eksler, V., Malenovsky, V., Norvell, E., Pobloth, H., Miao, L., Wang, Z., Laaksonen, L., and Vasilache, A. (2015, January 19–24). Overview of the EVS codec architecture. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’15), South Brisbane, QLD, Australia.10.1109/ICASSP.2015.7179063 ↗
12. Kankanahalli, S. (2018, January 15–20). End-To-End Optimized Speech Coding with Deep Neural Networks. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.10.1109/ICASSP.2018.8461487 ↗
13. Zhen, K., Sung, J., Lee, M.S., Beack, S., and Kim, M. (2019). Cascaded Cross-Module Residual Learning towards Lightweight End-to-End Speech Coding. arXiv.10.21437/Interspeech.2019-1816 ↗
14. Gârbacea, C., van den Oord, A., Li, Y., Lim, F.S., Luebs, A., Vinyals, O., and Walters, T.C. (2019, January 12–17). Low bit-rate speech coding with VQ-VAE and a WaveNet decoder. Proceedings of the ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, UK.10.1109/ICASSP.2019.8683277 ↗
15. Kleijn, W.B., Lim, F.S., Luebs, A., Skoglund, J., Stimberg, F., Wang, Q., and Walters, T.C. (2018, January 15–20). WaveNet based low rate speech coding. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.10.1109/ICASSP.2018.8462529 ↗
16. Cognitive speech coding: Examining the impact of cognitive speech processing on speech compression10.1109/MSP.2017.2761895 ↗
17. (2015). Method for the Subjective Assessment of Intermediate Quality Level of Audio Systems (Standard No. ITU-R Recommendation BS.1534-3).
18. van den Oord, A., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., and Kavukcuoglu, K. (2016). WaveNet: A Generative Model for Raw Audio. arXiv.
19. Multiband excitation vocoder10.1109/29.1651 ↗
20. (2011). Perceptual Objective Listening Quality Assessment (Standard No. ITU-T Recommendation P. 863).
21. A mixed excitation LPC vocoder model for low bit rate speech coding10.1109/89.397089 ↗
22. Kleijn, W.B., Storus, A., Chinen, M., Denton, T., Lim, F.S., Luebs, A., Skoglund, J., and Yeh, H. (2021, January 6–11). Generative Speech Coding with Predictive Variance Regularization. Proceedings of the ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada.10.1109/ICASSP39728.2021.9415120 ↗
23. Neural discrete representation learning
24. (1990). 40, 32, 24, 16 kbit/s Adaptive Differential Pulse Code Modulation (ADPCM) (Standard No. ITU-T Recommendation G.726).
25. (1990). 5-, 4-, 3- and 2-bit/Sample Embedded Adaptive Differential Pulse Code Modulation (ADPCM) (Standard No. ITU-T Recommendation G.727).
26. Gibson, J.D., Berger, T., Lookabaugh, T., Lindbergh, D., and Baker, R.L. (1998). Digital Compression for Multimedia: Principles and Standards, Morgan Kaufmann Publishers Inc.
27. Stability and performance analysis of pitch filters in speech coders10.1109/TASSP.1987.1165238 ↗
28. Pettigrew, R., and Cuperman, V. (1989, January 27–30). Backward pitch prediction for low-delay speech coding. Proceedings of the GLOBECOM, Dallas, TX, USA.
29. Berger, T. (1971). Rate Distortion Theory, Prentice-Hall.
30. Low delay tree coding of speech at 8 kbit/s10.1109/89.294349 ↗
31. Incremental tree coding of speech10.1109/TIT.1981.1056365 ↗
32. Perceptual Audio Coding using Adaptive Pre- and Post-Filters and Lossless Compression10.1109/TSA.2002.803444 ↗
33. Shetty, N., and Gibson, J.D. (2007, January 4–7). Perceptual Pre-weighting and Post-inverse weighting for Speech Coding. Proceedings of the 41st Annual Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, CA, USA.10.1109/ACSSC.2007.4487268 ↗
34. (1998). ITU-T Coded-Speech Database (Standard No. ITU-T Recommendation P. Supplement 23).
35. Estimation of autoregressive signal plus noise10.1214/aos/1176342616 ↗
36. The effects of noise on the autoregressive spectral estimator10.1109/TASSP.1979.1163275 ↗
37. Backward adaptive prediction as spectral analysis in a closed loop10.1109/TASSP.1985.1164681 ↗
38. 3GPP (2009). Mandatory Speech Codec Speech Processing Functions; Adaptive Multi-Rate (AMR) Speech Codec; Comfort Noise Aspects, 3rd Generation Partnership Project (3GPP). TS 26.092.
39. Gibson, J.D. (2015). Chapter 2 Challenges in Speech Coding. Speech and Audio Processing for Coding, Enhancement and Recognition, Springer.10.1007/978-1-4939-1456-2_2 ↗
40. Ramo, A., and Toukomaa, H. (2015, January 19–24). Subjective Quality Assessment of the 3GPP EVS codec. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’15), South Brisbane, QLD, Australia.10.1109/ICASSP.2015.7178954 ↗
41. Lossy Source Coding10.1109/18.720552 ↗
42. (1992). Coding of Speech at 16 kbit/s Using Low-Delay Code Excited Linear Prediction (Standard No. ITU-T Recommendation G.728).
43. A new class of lower bounds to information rates of stationary sources via conditional rate-distortion functions10.1109/TIT.1973.1055050 ↗
44. Li, Y.Y., and Gibson, J.D. (2011, January 11–15). Rate Distortion Bounds for Speech Coding based on a Perceptual Distortion Measure (PESQ-MOS). Proceedings of the IEEE International Conference on Multimedia and Expo (ICME’11), Barcelona, Spain.
45. (1988). 7 kHz Audio-Coding within 64 kbits/s (Standard No. ITU-T Recommendation G.722).
46. Li, Y.-Y., and Gibson, J.D. (2011, January 6–9). Scalable Multimode Tree Coder with Perceptual Pre-weighting and Post-weighting forWideband Speech Coding. Proceedings of the 45th Annual Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, CA, USA.10.1109/ACSSC.2011.6190068 ↗
47. Oh, H., and Gibson, J.D. (2020, January 1–4). Output Recursively Adaptive (ORA) Tree Coding of Speech with VAD/CNG. Proceedings of the 54th Annual Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, CA, USA.10.1109/IEEECONF51394.2020.9443472 ↗