An Efficient SMOTE-Based Deep Learning Model for Voice Pathology Detection
Source abstract
Abstract
The Saarbruecken Voice Database (SVD) is a public database used by voice pathology detection systems. However, the distributions of the pathological and normal voice samples show a clear class imbalance. This study aims to develop a system for the classification of pathological and normal voices that uses efficient deep learning models based on various oversampling methods, such as the adaptive synthetic sampling (ADASYN), synthetic minority oversampling technique (SMOTE), and Borderline-SMOTE directly applied to feature parameters. The suggested combinations of oversampled linear predictive coefficients (LPCs), mel-frequency cepstral coefficients (MFCCs), and deep learning methods can efficiently classify pathological and normal voices. The balanced datasets from ADASYN, SMOTE, and Borderline-SMOTE are used to validate and evaluate the various deep learning models. The experiments are conducted using model evaluation metrics such as the recall, specificity, G, and F1 value. The experimental results suggest that the proposed voice pathology detection (VPD) system integrating the LPCs oversampled by the SMOTE and a convolutional neural network (CNN) can effectively yield the highest accuracy at 98.89% when classifying pathological and normal voices. Finally, the performances of oversampling algorithms such as the ADASYN, SMOTE, and Borderline-SMOTE are discussed. Furthermore, the performance of SMOTE is superior to conventional imbalanced data oversampling algorithms, and it can be used to diagnose pathological signals in real-world applications.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Voice and Speech Disorders · Music and Audio Processing · Speech Recognition and Synthesis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Division of Global Business Languages, Seokyeong University, Seogyeong-ro Seongbuk-gu, Seoul 02173, Republic of Korea
Department of Bigdata Medical Convergence, Eulji University, 553 Sanseong-daero, Sujeong-gu, Seongnam-si 13135, Republic of Korea
Funding
National Research Foundation of Korea (NRF)
References (40)
Show source-provided references
1. Miliaresi, I., Poutos, K., and Pikrakis, A. (2021, January 18–21). Combining acoustic features and medical data in deep learning networks for voice pathology classification. Proceedings of the 2020 28th European Signal Processing Conference (EUSIPCO), Amsterdam, The Netherlands.10.23919/Eusipco47968.2020.9287333 ↗
2. Jinyang, Q., Denghuang, Z., Ziqi, F., Di, W., Yishen, X., and Zhi, T. (2021, January 21–23). Pathological Voice Feature Generation Using Generative Adversarial Network. Proceedings of the 2021 International Conference on Sensing, Measurement & Data Analytics in the era of Artificial Intelligence (ICSMD), Nanjing, China.10.1109/ICSMD53520.2021.9670757 ↗
3. Khan, M.A., and Kim, J. (2020). Toward Developing Efficient Conv-AE-Based Intrusion Detection System Using Heterogeneous Dataset. Electronics, 9.10.3390/electronics9111771 ↗
4. A Survey of Voice Pathology Surveillance Systems Based on Internet of Things and Machine Learning Algorithms10.1109/ACCESS.2020.2984925 ↗
5. Mohammed, M.A., Abdulkareem, K.H., Mostafa, S.A., Khanapi Abd Ghani, M., Maashi, M.S., Garcia-Zapirain, B., Oleagordia, I., Alhakami, H., and AL-Dhief, F.T. (2020). Voice Pathology Detection and Classification Using Convolutional Neural Network Model. Appl. Sci., 10.10.3390/app10113723 ↗
6. Exploring the Use of Artificial Intelligence Techniques to Detect the Presence of Coronavirus Covid-19 Through Speech and Voice Analysis10.1109/ACCESS.2021.3075571 ↗
7. A Pathological Multi-Vowels Recognition Algorithm Based on LSP Feature10.1109/ACCESS.2019.2911314 ↗
8. Automatic Voice Pathology Monitoring Using Parallel Deep Models for Smart Healthcare10.1109/ACCESS.2019.2905597 ↗
9. Leveraging Artificial Intelligence to Improve Voice Disorder Identification Through the Use of a Reliable Mobile App10.1109/ACCESS.2019.2938265 ↗
10. Voice Disorder Identification by Using Machine Learning Techniques10.1109/ACCESS.2018.2816338 ↗
11. Eye, M., and Infirmary, E. (1994). Voice Disorders Database, Version. 1.03 (cd-rom), Kay Elemetrics Corporation.
12. William, J.B., and Manfred, P. (2007). Saarbrucken Voice Database, Institute of Phonetics, Univ. of Saarland. Available online: http://www.stimmdatenbank.coli.uni-saarland.de/2007.
13. Survey on Signal Processing Based Pathological Voice Detection Techniques10.1109/ACCESS.2020.2985280 ↗
14. Comparison of Cepstral Features in the Detection of Pathological Voices by Varying the Input and Filterbank of the Cepstrum Computation10.1109/ACCESS.2021.3117665 ↗
15. Voice data mining for laryngeal pathology assessment10.1016/j.compbiomed.2015.07.026 ↗
16. two-stage variable selection and classification approach for Parkin-son’s disease detection by using voice recording replications10.1016/j.cmpb.2017.02.019 ↗
17. Investigation and Evaluation of Glottal Flow Waveform for Voice Pathology Detection10.1109/ACCESS.2020.3046767 ↗
18. Novel Multi Center and Threshold Ternary Pattern Based Method for Disease Detection Method Using Voice10.1109/ACCESS.2020.2992641 ↗
19. Chicco, D., and Jurman, G. (2020). The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation. BMC Genom., 21.10.1186/s12864-019-6413-7 ↗
20. Overly optimistic prediction results on imbalanced data: A case study of flaws and benefits when applying over-sampling10.1016/j.artmed.2020.101987 ↗
21. Multiset feature learning for highly imbalanced data classification10.1109/TPAMI.2019.2929166 ↗
22. Chui, K.T., Lytras, M., and Vasant, P. (2020). Combined Generative Adversarial Network and Fuzzy C-Means Clustering for MultiClass Voice Disorder Detection with an Imbalanced Dataset. Appl. Sci., 10.10.3390/app10134571 ↗
23. Fan, Z., Qian, J., Sun, B., Wu, D., Xu, Y., and Tao, Z. (2020, January 15–17). Modeling Voice Pathology Detection Using Imbalanced Learning. Proceedings of the 2020 International Conference on Sensing, Measurement & Data Analytics in the era of Artificial Intelligence (ICSMD), Xi’an, China.10.1109/ICSMD50554.2020.9261679 ↗
24. Fan, Z., Wu, Y., Zhou, C., Zhang, X., and Tao, Z. (2021). Class-Imbalanced Voice Pathology Detection and Classification Using Fuzzy Cluster Oversampling Method. Appl. Sci., 10.10.3390/app11083450 ↗
25. Unsupervised Feature Learning for Environmental Sound Classification Using Weighted Cycle-Consistent Generative Adversarial Network10.1016/j.asoc.2019.105912 ↗
26. Trinh, N.H., and O’Brien, D. (2020, January 11–12). Semi-Supervised Learning with Generative Adversarial Networks for Pathological Speech Classification. Proceedings of the 2020 31st Irish Signals and Systems Conference (ISSC), Letterkenny, Ireland.10.1109/ISSC49989.2020.9180211 ↗
27. SMOTE: Synthetic minority over-sampling technique10.1613/jair.953 ↗
28. SMOTE for high-dimensional class-imbalanced data10.1186/1471-2105-14-106 ↗
29. Hui, H., Wang, W.Y., and Mao, B.H. (2005, January 23–26). Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning. Proceedings of the International Conference on Intelligent Computing, Hefei, China.
30. He, H., Bai, Y., Garcia, E.A., and Li, S. (2008, January 1–8). ADASYN: Adaptive synthetic sampling approach for imbalanced learning. Proceedings of the 2008 IEEE International Joint Conference on Neural Networks, Hong Kong, China.
31. Dong, Y., and Wang, X. (2013, January 10–12). A New Over-Sampling Approach: Random-SMOTE for Learning from Imbalanced Data Sets. Proceedings of the International Conference on Knowledge Science, Engineering and Management, Dalian, China.
32. Improving imbalanced learning through a heuristic oversampling method based on k-means and SMOTE10.1016/j.ins.2018.06.056 ↗
33. Clustering-based undersampling in-class imbalanced data
34. Metric Learning from Imbalanced Data with Generalization Guarantees10.1016/j.patrec.2020.03.008 ↗
35. Alim, S.A., and Alang Rashid, N.K. (2022, December 29). Some Commonly Used Speech Feature Extraction Algorithms. Available online: https://www.intechopen.com/chapters/63970.
36. Linear Prediction: A Tutorial Review10.1109/PROC.1975.9792 ↗
37. Real-time implementation and performance evaluation of speech classifiers in speech analysis-synthesis10.4218/etrij.2019-0364 ↗
38. Lee, J.Y. (2021). Experimental Evaluation of Deep Learning Methods for an Intelligent Pathological Voice Detection System Using the Saarbruecken Voice Database. Appl. Sci., 11.10.3390/app11157149 ↗
39. Analysis and Detection of Pathological Voice Using Glottal Source Features10.1109/JSTSP.2019.2957988 ↗
40. An incremental method combining density clustering and support vector machines for voice pathology detection10.1016/j.compeleceng.2016.08.021 ↗