The Speaker Identification Model for Air-Ground Communication Based on a Parallel Branch Architecture
Source abstract
Abstract
This study addresses the challenges of complex noise and short speech in civil aviation air-ground communication scenarios and proposes a novel speaker identification model, Chrono-ECAPA-TDNN (CET). The aim of the study is to enhance the accuracy and robustness of speaker identification in these environments. The CET model incorporates three key components: the Chrono Block module, the speaker embedding extraction module, and the optimized loss function module. The Chrono Block module utilizes parallel branching architecture, Bi-LSTM, and multi-head attention mechanisms to effectively extract both global and local features, addressing the challenge of short speech. The speaker embedding extraction module aggregates features from the Chrono Block and employs self-attention statistical pooling to generate robust speaker embeddings. The loss function module introduces the Sub-center AAM-Softmax loss, which improves feature compactness and class separation. To further improve robustness, data augmentation techniques such as speed perturbation, spectral masking, and random noise suppression are applied. Pretraining on the VoxCeleb2 dataset and testing on the air-ground communication dataset, the CET model achieves 9.81% EER and 88.62% accuracy, outperforming the baseline ECAPA-TDNN model by 1.53% in EER and 2.19% in accuracy. The model also demonstrates strong performance on four cross-domain datasets, highlighting its broad potential for real-time applications.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Speech and Audio Processing · Speech Recognition and Synthesis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Air Traffic Management, Civil Aviation Flight University of China, Guanghan 618307, China
Funding
National Natural Science Foundation of China · National Key R&D Program of China · Sichuan Provincial Civil Aviation Flight Technology and Flight Safety Engineering Technology Research Center · Fundamental Research Funds for the Central Universities Grant Number
References (37)
Show source-provided references
1. An overview of speaker identification: Accuracy and robustness issues10.1109/MCAS.2011.941079 ↗
2. Livoauth: Liveness detection in voiceprint authentication with random challenges and detection modes10.1109/TII.2022.3213830 ↗
3. A review on speaker recognition: Technology and challenges10.1016/j.compeleceng.2021.107005 ↗
4. Snyder, D., Garcia-Romero, D., Sell, G., Povey, D., and Khudanpur, S. (2018, January 15–20). X-vectors: Robust dnn embeddings for speaker recognition. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.10.1109/ICASSP.2018.8461375 ↗
5. Desplanques, B., Thienpondt, J., and Demuynck, K. (2020, January 25–29). Ecapa-tdnn: Emphasized channel attention, propagation and aggregation in tdnn based speaker verification. Proceedings of the NTERSPEECH 2020, Shanghai, China.10.21437/Interspeech.2020-2650 ↗
6. Pan, W., Wang, Y., Zhang, Y., and Han, B. (2024). ATC-SD Net: Radiotelephone Communications Speaker Diarization Network. Aerospace, 11.10.3390/aerospace11070599 ↗
7. Chung, J.S., Nagrani, A., and Zisserman, A. (2018, January 2–6). Voxceleb2: Deep speaker recognition. Proceedings of the Interspeech 2018, Hyderabad, India.10.21437/Interspeech.2018-1929 ↗
8. Phone recognition on the TIMIT database
9. Panayotov, V., Chen, G., Povey, D., and Khudanpur, S. (2015, January 19–24). Librispeech: An asr corpus based on public domain audio books. Proceedings of the 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brisbane, Australia.10.1109/ICASSP.2015.7178964 ↗
10. Voxceleb: Large-scale speaker verification in the wild10.1016/j.csl.2019.101027 ↗
11. Fan, Y., Kang, J., Li, L., Li, K., Chen, H., Cheng, S., Zhang, P., Zhou, Z., Cai, Y., and Wang, D. (2020, January 4–8). Cn-celeb: A challenging chinese speaker recognition dataset. Proceedings of the ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.10.1109/ICASSP40776.2020.9054017 ↗
12. Chen, J.-Y., and Jeng, J.-T. (2024, January 26–28). Text-Independent Speaker Verification Using Lightweight 3D Convolutional Neural Networks. Proceedings of the 2024 International Conference on System Science and Engineering (ICSSE), Hsinchu, Taiwan.10.1109/ICSSE61472.2024.10608879 ↗
13. Speaker identification model based on deep neural networks
14. Bayesian self-attentive speaker embeddings for text-independent speaker verification10.1109/TASLP.2023.3244502 ↗
15. Snyder, D., Garcia-Romero, D., Povey, D., and Khudanpur, S. (2017, January 20–24). Deep neural network embeddings for text-independent speaker verification. Proceedings of the Interspeech, Stockholm, Sweden.10.21437/Interspeech.2017-620 ↗
16. Wan, L., Wang, Q., Papir, A., and Moreno, I.L. (2018, January 15–20). Generalized end-to-end loss for speaker verification. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.10.1109/ICASSP.2018.8462665 ↗
17. Zhang, C., and Koishida, K. (2017, January 20–24). End-to-end text-independent speaker verification with triplet loss on short utterances. Proceedings of the Interspeech, Stockholm, Sweden.10.21437/Interspeech.2017-1608 ↗
18. Variani, E., Lei, X., McDermott, E., Moreno, I.L., and Gonzalez-Dominguez, J. (2014, January 4–9). Deep neural networks for small footprint text-dependent speaker verification. Proceedings of the 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy.10.1109/ICASSP.2014.6854363 ↗
19. Zhu, Y., Ko, T., Snyder, D., Mak, B., and Povey, D. (2018, January 2–6). Self-attentive speaker embeddings for text-independent speaker verification. Proceedings of the Interspeech, Hyderabad, India.10.21437/Interspeech.2018-1158 ↗
20. Vydana, H.K., and Vuppala, A.K. (September, January 28). Residual neural networks for speech recognition. Proceedings of the 2017 25th European Signal Processing Conference (Eusipco), Kos Island, Greece.10.23919/EUSIPCO.2017.8081266 ↗
21. Chung, J.S., Huh, J., Mun, S., Lee, M., Heo, H.S., Choe, S., Ham, C., Jung, S., Lee, B.-J., and Han, I. (2020, January 25–28). In defence of metric learning for speaker recognition. Proceedings of the Interspeech 2020, Shanghai, China.10.21437/Interspeech.2020-1064 ↗
22. Liu, B., and Qian, Y. (2023, January 20–24). ECAPA++: Fine-grained deep embedding learning for TDNN based speaker verification. Proceedings of the International Speech Communication Association (INTERSPEECH 2023), Dublin, Ireland.10.21437/Interspeech.2023-777 ↗
23. Zhang, E., Wu, Y., and Tang, Z. (2024, January 25–28). SC-EcapaTdnn: ECAPA-TDNN with Separable Convolutional for Speaker Recognition. Proceedings of the International Conference on Intelligence Science, Nanjing, China.10.1007/978-3-031-71253-1_21 ↗
24. Bionic Cepstral coefficients (BCC): A new auditory feature extraction to noise-robust speaker identification10.1016/j.apacoust.2024.110026 ↗
25. Chauhan, N., Isshiki, T., and Li, D. (2024, January 6–8). Enhancing Speaker Recognition Models with Noise-Resilient Feature Optimization Strategies. Proceedings of the Acoustics, Broadbeach, Australia.10.3390/acoustics6020024 ↗
26. A proxy learning curve for the Bayes classifier10.1016/j.patcog.2022.109240 ↗
27. CITISEN: A deep learning-based speech signal-processing mobile application10.1109/ACCESS.2022.3153469 ↗
28. Generative Adversarial Networks and Markov Random Fields for oversampling very small training sets10.1016/j.eswa.2020.113819 ↗
29. A speaker identification-verification approach for noise-corrupted and improved speech using fusion features and a convolutional neural network10.1007/s41870-024-01877-z ↗
30. Zhao, Z., Li, Z., Wang, W., and Zhang, P. (2023, January 4–10). Pcf: Ecapa-tdnn with progressive channel fusion for speaker verification. Proceedings of the ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece.10.1109/ICASSP49357.2023.10095051 ↗
31. Yao, J., Liang, C., Peng, Z., Zhang, B., and Zhang, X.-L. (2023, January 20–24). Branch-ECAPA-TDNN: A parallel branch architecture to capture local and global features for speaker verification. Proceedings of the International Speech Communication Association (INTERSPEECH 2023), Dublin, Ireland.10.21437/Interspeech.2023-402 ↗
32. Robustness study of speaker recognition based on ECAPA-TDNN-CIFG
33. Deng, J., Guo, J., Liu, T., Gong, M., and Zafeiriou, S. (2020;, January 23–28). Sub-center arcface: Boosting face recognition by large-scale noisy web faces. Proceedings of the Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK. Proceedings, Part XI 16.10.1007/978-3-030-58621-8_43 ↗
34. Higuchi, Y., Inaguma, H., Watanabe, S., Ogawa, T., and Kobayashi, T. (2021, January 6–11). Improved Mask-CTC for non-autoregressive end-to-end ASR. Proceedings of the ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada.10.1109/ICASSP39728.2021.9414198 ↗
35. Sato, H., Moriya, T., Mimura, M., Horiguchi, S., Ochiai, T., Ashihara, T., Ando, A., Shinayama, K., and Delcroix, M. (2024, January 1–5). Speakerbeam-ss: Real-time target speaker extraction with lightweight conv-tasnet and state space modeling. Proceedings of the Interspeech 2024, Kos, Greece.10.21437/Interspeech.2024-413 ↗
36. Ranking of classification algorithms in terms of mean–standard deviation using A-TOPSIS10.1007/s40745-018-0136-5 ↗
37. Zhang, Y., Lv, Z., Wu, H., Zhang, S., Hu, P., Wu, Z., Lee, H.-y., and Meng, H. (2022, January 18–22). Mfa-conformer: Multi-scale feature aggregation conformer for automatic speaker verification. Proceedings of the Interspeech 2022, Incheon, Republic of Korea.10.21437/Interspeech.2022-563 ↗