journal article·2023-06-10Open access

Combined Bidirectional Long Short-Term Memory with Mel-Frequency Cepstral Coefficients Using Autoencoder for Speaker Recognition

Young-Long Chen, Neng-Chung Wang, Jing-Fong Ciou, Rui-Qi Lin

Applied Sciences· Volume 13· Issue 12

Abstract

Recently, neural network technology has shown remarkable progress in speech recognition, including word classification, emotion recognition, and identity recognition. This paper introduces three novel speaker recognition methods to improve accuracy. The first method, called long short-term memory with mel-frequency cepstral coefficients for triplet loss (LSTM-MFCC-TL), utilizes MFCC as input features for the LSTM model and incorporates triplet loss and cluster training for effective training. The second method, bidirectional long short-term memory with mel-frequency cepstral coefficients for triplet loss (BLSTM-MFCC-TL), enhances speaker recognition accuracy by employing a bidirectional LSTM model. The third method, bidirectional long short-term memory with mel-frequency cepstral coefficients and autoencoder features for triplet loss (BLSTM-MFCCAE-TL), utilizes an autoencoder to extract additional AE features, which are then concatenated with MFCC and fed into the BLSTM model. The results showed that the performance of the BLSTM model was superior to the LSTM model, and the method of adding AE features achieved the best learning effect. Moreover, the proposed methods exhibit faster computation times compared to the reference GMM-HMM model. Therefore, utilizing pre-trained autoencoders for speaker encoding and obtaining AE features can significantly enhance the learning performance of speaker recognition. Additionally, it also offers faster computation time compared to traditional methods.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Speech Recognition and Synthesis · Speech and Audio Processing · Music and Audio Processing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science and Information Engineering, National Taichung University of Science and Technology, Taichung 404336, Taiwan

Department of Computer Science and Information Engineering, National United University, Miaoli 360302, Taiwan

Funding

National Science and Technology Council (NSTC) of the Republic of China

References (34)

Show source-provided references
1. Self-defined text-dependent wake-up-words speaker recognition system10.1109/ACCESS.2021.3117602 ↗
2. Mohammadi, M., and Sadegh Mohammadi, H.R. (2017, January 2–4). Robust features fusion for text independent speaker verification enhancement in noisy environments. Proceedings of the Iranian Conference on Electrical Engineering, Tehran, Iran.10.1109/IranianCEE.2017.7985357 ↗
3. Multi-source domain adaptation for text-independent forensic speaker recognition10.1109/TASLP.2021.3130975 ↗
4. Forensic speaker recognition10.1109/MSP.2008.931100 ↗
5. Speaker recognition by machines and humans: A tutorial review10.1109/MSP.2015.2462851 ↗
6. Noda, J.J., Travieso-González, C.M., Sánchez-Rodríguez, D., and Alonso-Hernández, J.B. (2019). Acoustic classification of singing insects based on MFCC/LFCC fusion. Appl. Sci., 9.10.3390/app9194097 ↗
7. Voice recognition algorithms using Mel frequency cepstral coefficient (MFCC) and dynamic time warping (DTW) techniques
8. Dighore, V.D., and Thool, V.R. (2016, January 20–21). Analysis of asthma by using Mel frequency cepstral coefficient. Proceedings of the IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology, Bangalore, India.10.1109/RTEICT.2016.7807974 ↗
9. An overview of text-independent speaker recognition: From features to supervectors10.1016/j.specom.2009.08.009 ↗
10. A novel windowing technique for efficient computation of MFCC for speaker recognition10.1109/LSP.2012.2235067 ↗
11. Alashban, A.A., Qamhan, M.A., Meftah, A.H., and Alotaibi, Y.A. (2022). Spoken language identification system using convolutional recurrent neural network. Appl. Sci., 12.10.3390/app12189181 ↗
12. Speaker-independent phone recognition using hidden Markov models10.1109/29.46546 ↗
13. Robust text-independent speaker identification using Gaussian mixture speaker models10.1109/89.365379 ↗
14. Significance of GMM-UBM based modelling for indian language identification10.1016/j.procs.2015.06.027 ↗
15. Efficient processing of deep neural networks: A tutorial and survey10.1109/JPROC.2017.2761740 ↗
16. Whispered speech recognition using deep denoising autoencoder10.1016/j.engappai.2016.12.012 ↗
17. Deep neural network approaches to speaker and language recognition10.1109/LSP.2015.2420092 ↗
18. An RNN-based prosodic information synthesizer for mandarin text-to-speech10.1109/89.668817 ↗
19. Prognosis of defect propagation based on recurrent neural networks10.1109/TIM.2010.2078296 ↗
20. Adam, K., Smagulova, K., and James, A.P. (2018, January 26–30). Memristive LSTM network hardware architecture for time-series predictive modeling problems. Proceedings of the IEEE Asia Pacific Conference on Circuits and Systems, Chengdu, China.10.1109/APCCAS.2018.8605649 ↗
21. Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) network10.1016/j.physd.2019.132306 ↗
22. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
23. Online training of LSTM networks in distributed systems for variable length data sequences10.1109/TNNLS.2017.2770179 ↗
24. Novel efficient RNN and LSTM-like architectures: Recurrent and gated broad learning systems and their applications for text classification10.1109/TCYB.2020.2969705 ↗
25. Speech emotion classification using attention-based LSTM10.1109/TASLP.2019.2925934 ↗
26. Speech emotion recognition considering nonverbal vocalization in affective conversations10.1109/TASLP.2021.3076364 ↗
27. Framewise phoneme classification with bidirectional LSTM and other neural network architectures10.1016/j.neunet.2005.06.042 ↗
28. Alamsyah, R.D., and Suyanto, S. (2020, January 10–11). Speech gender classification using bidirectional long short term memory. Proceedings of the International Seminar on Research of Information Technology and Intelligent Systems, Yogyakarta, Indonesia.10.1109/ISRITI51436.2020.9315380 ↗
29. Clustering-based speech emotion recognition by incorporating learned features and deep BiLSTM10.1109/ACCESS.2020.2990405 ↗
30. Native language identification in very short utterances using bidirectional long short-term memory network10.1109/ACCESS.2019.2896453 ↗
31. Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7–12). FaceNet: A unified embedding for face recognition and clustering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298682 ↗
32. Euclidean distance mapping10.1016/0146-664X(80)90054-4 ↗
33. A survey of speaker recognition: Fundamental theories, recognition methods and opportunities10.1109/ACCESS.2021.3084299 ↗
34. Bu, H., Du, J., Na, X., Wu, B., and Zheng, H. (2017, January 1–3). AISHELL-1: An open-source mandarin speech corpus and a speech recognition baseline. Proceedings of the Oriental Chapter of the International Coordinating Committee on Speech Databases and Speech I/O Systems and Assessment, Seoul, Korea.10.1109/ICSDA.2017.8384449 ↗