Biomimetic Computing for Efficient Spoken Language Identification
Source abstract
Abstract
Spoken Language Identification (SLID)-based applications have become increasingly important in everyday life, driven by advancements in artificial intelligence and machine learning. Multilingual countries utilize the SLID method to facilitate speech detection. This is accomplished by determining the language of the spoken parts using language recognizers. On the other hand, when working with multilingual datasets, the presence of multiple languages that have a shared origin presents a significant challenge for accurately classifying languages using automatic techniques. Further, one more challenge is the significant variance in speech signals caused by factors such as different speakers, content, acoustic settings, language differences, changes in voice modulation based on age and gender, and variations in speech patterns. In this study, we introduce the DBODL-MSLIS approach, which integrates biomimetic optimization techniques inspired by natural intelligence to enhance language classification. The proposed method employs Dung Beetle Optimization (DBO) with Deep Learning, simulating the beetle’s foraging behavior to optimize feature selection and classification performance. The proposed technique integrates speech preprocessing, which encompasses pre-emphasis, windowing, and frame blocking, followed by feature extraction utilizing pitch, energy, Discrete Wavelet Transform (DWT), and Zero crossing rate (ZCR). Further, the selection of features is performed by DBO algorithm, which removes redundant features and helps to improve efficiency and accuracy. Spoken languages are classified using Bayesian optimization (BO) in conjunction with a long short-term memory (LSTM) network. The DBODL-MSLIS technique has been experimentally validated using the IIIT Spoken Language dataset. The results indicate an average accuracy of 95.54% and an F-score of 84.31%. This technique surpasses various other state-of-the-art models, such as SVM, MLP, LDA, DLA-ASLISS, HMHFS-IISLFAS, GA base fusion, and VGG-16. We have evaluated the accuracy of our proposed technique against state-of-the-art biomimetic computing models such as GA, PSO, GWO, DE, and ACO. While ACO achieved up to 89.45% accuracy, our Bayesian Optimization with LSTM outperformed all others, reaching a peak accuracy of 95.55%, demonstrating its effectiveness in enhancing spoken language identification. The suggested technique demonstrates promising potential for practical applications in the field of multi-lingual voice processing.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Natural Language Processing Techniques · Speech and dialogue systems · Hand Gesture Recognition Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical and Instrumentation Engineering, Thapar Institute of Engineering and Technology, Patiala 147001, India
References (37)
Show source-provided references
1. Spoken Language Recognition: From Fundamentals to Practice10.1109/JPROC.2012.2237151 ↗
2. Srivastava, B.L., Vydana, H., Vuppala, A.K., and Shrivastava, M. (2017, January 14–19). Significance of neural phonotactic models for large-scale spoken language identification. Proceedings of the 2017 International Joint Conference on Neural Networks, Anchorage, AK, USA.10.1109/IJCNN.2017.7966114 ↗
3. Language Identification: A Tutorial10.1109/MCAS.2011.941081 ↗
4. Linear predictive coefficients-based feature to identify top-seven spoken languages10.1142/S0218001420580069 ↗
5. Miao, X., McLoughlin, I., Yao, S., and Yan, Y. (2018, January 18–21). Improved conditional generative adversarial net classification for spoken language recognition. Proceedings of the 2018 IEEE Spoken Language Technology Workshop, Athens, Greece.10.1109/SLT.2018.8639522 ↗
6. Snyder, D., Garcia-Romero, D., McCree, A., Sell, G., Povey, D., and Khudanpur, S. (2018, January 26–29). Spoken language recognition using X-vectors. Proceedings of the Odyssey Speaker and Language Recognition Workshop, Les Sables d’Olonne, France.10.21437/Odyssey.2018-15 ↗
7. Mukherjee, S., Shivam, N., Gangwal, A., Khaitan, L., and Das, A.J. (2019, January 19–21). Spoken language recognition using CNN. Proceedings of the 2019 International Conference on Information Technology (ICIT), Bhubaneswar, India.10.1109/ICIT48102.2019.00013 ↗
8. Bartz, C., Herold, T., Yang, H., and Meinel, C. (2017, January 14–18). Language identification using deep convolutional recurrent neural networks. Proceedings of the International Conference on Neural Information Processing, Cham, Switzerland.10.1007/978-3-319-70136-3_93 ↗
9. Dutoit, T., Martín-Vide, C., and Pironkov, G. (2018). A syllable structure approach to spoken language recognition. Statistical Language and Speech Processing, Springer International Publishing.10.1007/978-3-030-00810-9 ↗
10. Das, H.S., and Roy, P. (2019). Chapter 5—A Deep Dive Into Deep Learning Techniques for Solving Spoken Language Identification Problems. Intelligent Speech Signal Processing, Elsevier.10.1016/B978-0-12-818130-0.00005-2 ↗
11. Rapid Language Identification10.1109/TASLP.2015.2419978 ↗
12. Alashban, A.A., Qamhan, M.A., Meftah, A.H., and Alotaibi, Y.A. (2022). Spoken language identification system using convolutional recurrent neural network. Appl. Sci., 12.10.3390/app12189181 ↗
13. A deep learning approach for identifying and discriminating spoken Arabic among other languages10.1109/ACCESS.2023.3241855 ↗
14. An automated speech recognition system using whale optimized random forest algorithm
15. Madhu, C., George, A., and Mary, L. (2017, January 28–30). Automatic language identification for seven Indian languages using higher-level features. Proceedings of the IEEE Conference on Signal Processing, Informatics, Communication and Energy Systems, Chennai, India.10.1109/SPICES.2017.8091332 ↗
16. Deep learning-based sign language recognition system using both manual and non-manual components fusion10.3934/math.2024105 ↗
17. Deep learning for spoken language identification: Can we visualize speech signal patterns?10.1007/s00521-019-04468-3 ↗
18. Lopez-Moreno, I., Gonzalez-Dominguez, J., Plchot, O., Martinez, D., Gonzalez-Rodriguez, J., and Moreno, P. (2014, January 4–9). Automatic Language Identification Using Deep Neural Networks. Proceedings of the 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy.10.1109/ICASSP.2014.6854622 ↗
19. Shukla, S., and Mittal, G. (2019). Spoken Language Identification Using ConvNets. Proceedings of the European Conference on Ambient Intelligence (AmI 2019), Springer. Lecture Notes in Computer Science.
20. van der Merwe, R. (2020). Triplet Entropy Loss: Improving the Generalisation of Short Speech Language Identification Systems. arXiv.
21. Abdullah, B.M., Kudera, J., Avgustinova, T., Möbius, B., and Klakow, D. (2020, January 13). Rediscovering the Slavic Continuum in Representations Emerging from Neural Models of Spoken Language Identification. Proceedings of the 7th Workshop on NLP for Similar Languages, Varieties and Dialects, Online.
22. Lu, X., Shen, P., Tsao, Y., and Kawai, H. (2021, January 6–11). Unsupervised neural adaptation model based on optimal transport for spoken language identification. Proceedings of the ICASSP 2021–2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada.10.1109/ICASSP39728.2021.9414045 ↗
23. Rangan, P., Teki, S., and Misra, H. (2020). Exploiting spectral augmentation for code-switched spoken language identification. arXiv.
24. Verma, M., and Buduru, A.B. (2020, January 24–26). Fine-grained language identification with multilingual CapsNet model. Proceedings of the 2020 IEEE Sixth International Conference on Multimedia Big Data (BigMM), New Delhi, India.10.1109/BigMM50055.2020.00023 ↗
25. Punjabi, S., Arsikere, H., Raeesy, Z., Chandak, C., Bhave, N., Bansal, A., Müller, M., Murillo, S., Rastrow, A., and Garimella, S. (2020). Streaming end-to-end bilingual asr systems with joint language identification. arXiv.
26. Curriculum Learning Based Approach for Noise Robust Language Identification Using DNN with Attention10.1016/j.eswa.2018.06.004 ↗
27. Efficient speech emotion recognition using modified feature extraction10.1016/j.imu.2020.100424 ↗
28. Automatic Speaker Recognition Using MFCC and Artificial Neural Network
29. Feature extraction algorithms to improve the speech emotion recognition rate10.1007/s10772-020-09672-4 ↗
30. Lei, B., Huang, H., Chen, G., Liang, J., and Long, H. (2024). DBO-CNN-BiLSTM: Dung Beetle Optimization Algorithm-Based Thrust Estimation for Micro-Aero Engine. Aerospace, 11.10.3390/aerospace11050344 ↗
31. Tian, C., Ma, J., Zhang, C., and Zhan, P. (2018). A deep neural network model for short-term load forecast based on long short-term memory network and convolutional neural network. Energies, 11.10.3390/en11123493 ↗
32. Jiang, C., Luo, Z., Guan, M., and Zhu, H. (2024). Low orbit regional enhanced navigation constellation for BDS3 design based on Bayesian optimization algorithm. Geodesy Geodyn.10.1016/j.geog.2023.12.003 ↗
33. (2024, October 21). IIIT Spoken Language Dataset. Available online: https://www.kaggle.com/datasets/sizlingdhairya1/iiit-spoken-language-datasets.
34. FuzzyGCP: A deep learning architecture for automatic spoken language identification from speech signals10.1016/j.eswa.2020.114416 ↗
35. Spoken language identification in unseen channel conditions using modified within-sample similarity loss10.1016/j.patrec.2022.04.018 ↗
36. A hybrid meta-heuristic feature selection method for identification of Indian spoken languages from audio signals10.1109/ACCESS.2020.3028241 ↗
37. The effect of synthetic voice data augmentation on spoken language identification on Indian languages10.1109/ACCESS.2023.3316142 ↗