A Hybrid U-Lossian Deep Learning Network for Screening and Evaluating Parkinson’s Disease
Source abstract
Abstract
Speech impairment analysis and processing technologies have evolved substantially in recent years, and the use of voice as a biomarker has gained popularity. We have developed an approach for clinical speech signal processing to demonstrate the promise of deep learning-driven voice analysis as a screening tool for Parkinson’s Disease (PD), the world’s second most prevalent neurodegenerative disease. Detecting Parkinson’s disease symptoms typically involves an evaluation by a movement disorder expert, which can be difficult to get and yield varied findings. A vocal digital biomarker might supplement the time-consuming traditional manual examination by recognizing and evaluating symptoms that characterize voice quality and level of deterioration. We present a deep learning based, custom U-lossian model for PD assessment and recognition. The study’s goal was to discover anomalies in the PD-affected voice and develop an automated screening method that can discriminate between the voices of PD patients and healthy volunteers while also providing a voice quality score. The classification accuracy was evaluated on two speech corpora (Italian PVS and own Lithuanian PD voice dataset) and we have found the result to be medically appropriate, with values of 0.8964 and 0.7949, confirming the proposed model’s high generalizability.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Voice and Speech Disorders · Dysphagia Assessment and Management · Speech Recognition and Synthesis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Informatics, Kaunas University of Technology, 51368 Kaunas, Lithuania
Department of Otorhinolaryngology, Lithuanian University of Health Sciences, 50061 Kaunas, Lithuania
Funding
European Regional Development Fund · Research Council of Lithuania (LMTLT)
References (99)
Show source-provided references
1. Incidence of Parkinson’s disease, dementia, cerebrovascular disease and stroke in bipolar disorder compared to other psychiatric disorders: An electronic health records network study of 66 million people10.1111/bdi.13022 ↗
2. Global Trends in the Incidence, Prevalence, and Years Lived With Disability of Parkinson’s Disease in 204 Countries/Territories From 1990 to 201910.3389/fpubh.2021.776847 ↗
3. Parkinson’s disease10.1016/S0140-6736(21)00218-X ↗
4. The patients’ perception of prodromal symptoms before the initial diagnosis of Parkinson’s disease10.1002/mds.23499 ↗
5. Potential impact of self-perceived prodromal symptoms on the early diagnosis of Parkinson’s disease10.1007/s00415-013-7125-6 ↗
6. Prediagnostic presentations of Parkinson’s disease in primary care: A case-control study10.1016/S1474-4422(14)70287-X ↗
7. The Onset of Nonmotor Symptoms in Parkinson’s disease (The ONSET PDStudy)10.1002/mds.26077 ↗
8. Presymptomatic compensation in Parkinson’s disease is not dopamine-mediated10.1016/S0166-2236(03)00038-9 ↗
9. MDS clinical diagnostic criteria for Parkinson’s disease10.1002/mds.26424 ↗
10. Midbrain hyperechogenicity, hyposmia, mild parkinsonian signs and risk for incident Parkinson’s disease over 10 years: A prospective population-based study10.1016/j.parkreldis.2019.12.008 ↗
11. Study protocol for using a smartphone application to investigate speech biomarkers of Parkinson’s disease and other synucleinopathies: SMARTSPEECH10.1136/bmjopen-2021-059871 ↗
12. Duffy, J.R. (2022, October 01). Motor Speech Disorders. Available online: https://www.elsevier.com/books/motor-speech-disorders/duffy/978-0-323-53054-5.
13. Examining multiple feature evaluation and classification methods for improving the diagnosis of Parkinson’s disease10.1016/j.cogsys.2018.12.004 ↗
14. A Multi-agent Feature Selection and Hybrid Classification Model for Parkinson’s Disease Diagnosis10.1145/3433180 ↗
15. Variability in fundamental frequency during speech in prodromal and incipient Parkinson’s disease: A longitudinal case study10.1016/j.bandc.2004.05.002 ↗
16. Quantitative acoustic measurements for characterization of speech and voice disorders in early untreated Parkinson’s disease10.1121/1.3514381 ↗
17. Speech Biomarkers in Rapid Eye Movement Sleep Behavior Disorder and Parkinson Disease10.1002/ana.26085 ↗
18. Quantitative assessment of motor speech abnormalities in idiopathic rapid eye movement sleep behaviour disorder10.1016/j.sleep.2015.07.030 ↗
19. Atzori, A., Carullo, A., Vallan, A., Cennamo, V., and Astolfi, A. (2019, January 26–28). Parkinson disease voice features for rehabilitation therapy and screening purposes. Proceedings of the 2019 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Istanbul, Turkey.10.1109/MeMeA.2019.8802223 ↗
20. Self-perceptions of speech, voice, and swallowing in motor phenotypes of Parkinson’s disease10.1016/j.prdoa.2020.100074 ↗
21. Social and psychological impact of the COVID-19 pandemic on people with Parkinson’s disease: A scoping review10.1016/j.puhe.2021.08.014 ↗
22. Erdogdu Sakar, B., Serbes, G., and Sakar, C.O. (2017). Analyzing the effectiveness of vocal features in early telediagnosis of Parkinson’s disease. PLoS ONE, 12.10.1371/journal.pone.0182428 ↗
23. Phonemes based detection of parkinson’s disease for telehealth applications10.1038/s41598-022-13865-z ↗
24. Imprecise vowel articulation as a potential early marker of Parkinson’s disease: Effect of speaking task10.1121/1.4816541 ↗
25. Parkinson Disease10.53830/XAGK4962 ↗
26. Validation of freely-available pitch detection algorithms across various noise levels in assessing speech captured by smartphone in Parkinson’s disease10.1016/j.bspc.2019.101831 ↗
27. Short-term effect of dopaminergic medication on speech in early-stage Parkinson’s disease10.1038/s41531-022-00286-y ↗
28. Cordella, F., Paffi, A., and Pallotti, A. (2021, January 23–25). Classification-based screening of Parkinson’s disease patients through voice signal. Proceedings of the 2021 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Lausanne, Switzerland.10.1109/MeMeA52024.2021.9478683 ↗
29. Detecting Parkinson’s disease with sustained phonation and speech signals using machine learning techniques10.1016/j.patrec.2019.04.005 ↗
30. Arora, S., and Tsanas, A. (2021). Assessing Parkinson’s Disease at Scale Using Telephone-Recorded Speech: Insights from the Parkinson’s Voice Initiative. Diagnostics, 11.10.3390/diagnostics11101892 ↗
31. Developing a large scale population screening tool for the assessment of Parkinson’s disease using telephone-quality voice10.1121/1.5100272 ↗
32. Smartphone Allows Capture of Speech Abnormalities Associated With High Risk of Developing Parkinson’s Disease10.1109/TNSRE.2018.2851787 ↗
33. Ehsan, M.T., Pranto, S.I., and Mamun, K.A. (2021, January 4–6). Real-Time Screening of Parkinson’s Disease based on Speech Analysis using Smartphone. Proceedings of the 2021 10th International IEEE/EMBS Conference on Neural Engineering (NER), Virtual.10.1109/NER49283.2021.9441145 ↗
34. The mPower study, Parkinson disease mobile data collected using ResearchKit10.1038/sdata.2016.11 ↗
35. Using Smartphones and Machine Learning to Quantify Parkinson Disease Severity10.1001/jamaneurol.2018.0809 ↗
36. Evaluation of smartphone-based testing to generate exploratory outcome measures in a phase 1 Parkinson’s disease clinical trial10.1002/mds.27376 ↗
37. Toward voice detection for screening rheumatology patients10.4103/injr.injr_27_21 ↗
38. A survey on computer-assisted Parkinson’s Disease diagnosis10.1016/j.artmed.2018.08.007 ↗
39. A Multiple-Classifier Framework for Parkinson’s Disease Detection Based on Various Vocal Tests
40. Nonlinear speech analysis algorithms mapped to a standard metric achieve clinically useful quantification of average Parkinson’s disease symptom severity10.1098/rsif.2010.0456 ↗
41. Diagnosis and Tracking of Parkinson’s Disease by using Automatically Extracted Acoustic Features
42. Pah, N.D., Motin, M.A., and Kumar, D.K. (2021). Voice Analysis for Diagnosis and Monitoring Parkinson’s Disease, Springer.10.1007/978-981-16-3056-9_8 ↗
43. Parkinson’s disease diagnosis: The effect of autoencoders on extracting features from vocal characteristics10.1016/j.array.2021.100079 ↗
44. Voice Tremor in Parkinson’s Disease: An Acoustic Study10.1016/j.jvoice.2017.12.010 ↗
45. Growing and Pruning Based Deep Neural Networks Modeling for Effective Parkinson’s Disease Diagnosis
46. Maskeliūnas, R., Kulikajevas, A., Damaševičius, R., Pribuišis, K., Ulozaitė-Stanienė, N., and Uloza, V. (2022). Lightweight Deep Learning Model for Assessment of Substitution Voicing and Speech after Laryngeal Carcinoma Surgery. Cancers, 14.10.3390/cancers14102366 ↗
47. Investigating voice as a biomarker: Deep phenotyping methods for early detection of Parkinson’s disease10.1016/j.jbi.2019.103362 ↗
48. Automated Detection of Parkinson’s Disease Based on Multiple Types of Sustained Phonations Using Linear Discriminant Analysis and Genetically Optimized Neural Network10.1109/JTEHM.2019.2940900 ↗
49. Viswanathan, R., Arjunan, S.P., Bingham, A., Jelfs, B., Kempster, P., Raghav, S., and Kumar, D.K. (2019). Complexity Measures of Voice Recordings as a Discriminative Tool for Parkinson’s Disease. Biosensors, 10.10.3390/bios10010001 ↗
50. Convolutional neural network ensemble for Parkinson’s disease detection from voice recordings10.1016/j.compbiomed.2021.105021 ↗
51. Polat, K. (2019, January 24–26). A Hybrid Approach to Parkinson Disease Classification Using Speech Signal: The Combination of SMOTE and Random Forests. Proceedings of the 2019 Scientific Meeting on Electrical-Electronics & Biomedical Engineering and Computer Science (EBBT), Istanbul, Turkey.10.1109/EBBT.2019.8741725 ↗
52. Automatic Parkinson disease detection at early stages as a pre-diagnosis tool by using classifiers and a small set of vocal features10.1016/j.bbe.2020.01.003 ↗
53. Automated detection of Parkinson’s disease using minimum average maximum tree and singular value decomposition method with vowels10.1016/j.bbe.2019.05.006 ↗
54. Detecting Effect of Levodopa in Parkinson’s Disease Patients Using Sustained Phonemes10.1109/JTEHM.2021.3066800 ↗
55. Parkinson’s Disease Detection Based on Running Speech Data From Phone Calls10.1109/TBME.2021.3116935 ↗
56. Loh, H.W., Hong, W., Ooi, C.P., Chakraborty, S., Barua, P.D., Deo, R.C., Soar, J., Palmer, E.E., and Acharya, U.R. (2021). Application of Deep Learning Models for Automated Identification of Parkinson’s Disease: A Review (2011–2021). Sensors, 21.10.3390/s21217034 ↗
57. Deep Clinical Phenotyping of Parkinson’s Disease: Towards a New Era of Research and Clinical Care10.1007/s43657-022-00051-4 ↗
58. Krishna, A., prakash Sahu, S., Janghel, R.R., and Singh, B.K. (2021). Speech Parameter and Deep Learning Based Approach for the Detection of Parkinson’s Disease. Computer Networks, Big Data and IoT, Springer.10.1007/978-981-16-0965-7_40 ↗
59. Few-shot learning of Parkinson’s disease speech data with optimal convolution sparse kernel transfer learning10.1016/j.bspc.2021.102850 ↗
60. Deep dual-side learning ensemble model for Parkinson speech recognition10.1016/j.bspc.2021.102849 ↗
61. Ouhmida, A., Terrada, O., Raihani, A., Cherradi, B., and Hamida, S. (2021, January 4–5). Voice-Based Deep Learning Medical Diagnosis System for Parkinson’s Disease Prediction. Proceedings of the 2021 International Congress of Advanced Technology and Engineering (ICOTEN), Virtual.10.1109/ICOTEN52080.2021.9493456 ↗
62. Hireš, M., Gazda, M., Vavrek, L., and Drotár, P. (2022, January 2–5). Voice-Specific Augmentations for Parkinson’s Disease Detection Using Deep Convolutional Neural Network. Proceedings of the 2022 IEEE 20th Jubilee World Symposium on Applied Machine Intelligence and Informatics (SAMI), Poprad, Slovakia.10.1109/SAMI54271.2022.9780856 ↗
63. Wodzinski, M., Skalski, A., Hemmerling, D., Orozco-Arroyave, J.R., and Nöth, E. (2019, January 23–27). Deep Learning Approach to Parkinson’s Disease Detection Using Voice Recordings and Convolutional Neural Network Dedicated to Image Classification. Proceedings of the 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Berlin, Germany.10.1109/EMBC.2019.8856972 ↗
64. Bull
65. Robust automated Parkinson disease detection based on voice signals with transfer learning10.1016/j.eswa.2021.115013 ↗
66. The Detection of Parkinson’s Disease From Speech Using Voice Source Information10.1109/TASLP.2021.3078364 ↗
67. Anisha, C., and Arulanand, N. (2020, January 13–14). Early Prediction of Parkinson’s Disease (PD) Using Ensemble Classifiers. Proceedings of the 2020 International Conference on Innovative Trends in Information Technology (ICITIIT), Kottayam, India.10.1109/ICITIIT49094.2020.9071562 ↗
68. Predicting Severity Of Parkinson’s Disease Using Deep Learning10.1016/j.procs.2018.05.154 ↗
69. Mir, W.A., Nissar, I., Rizvi, D.R., Masood, S., and Hussain, A. (2022, January 1–3). Deep Learning-based model for the detection of Parkinson’s disease using voice data. Proceedings of the 2022 First International Conference on Artificial Intelligence Trends and Pattern Recognition (ICAITPR), Paris, France.10.1109/ICAITPR51569.2022.9844185 ↗
70. An LSTM based Deep learning model for voice-based detection of Parkinsons disease
71. A Deep Learning Based Method for Parkinson’s Disease Detection Using Dynamic Features of Speech10.1109/ACCESS.2021.3051432 ↗
72. Exponential delta-AMS features and optimized deep learning for the classification of Parkinsons disease10.1615/CritRevBiomedEng.2022041442 ↗
73. Parkinson disease detection using energy direction features based on EMD from voice signal10.1016/j.bbe.2020.12.009 ↗
74. Multi-Variate vocal data analysis for Detection of Parkinson disease using Deep Learning10.1007/s00521-020-05233-7 ↗
75. Diagnostic Criteria for Parkinson’s Disease: From James Parkinson to the Concept of Prodromal Disease10.3389/fneur.2018.00156 ↗
76. Dimauro, G., and Girardi, F. (2022, October 01). Italian Parkinson’s Voice and Speech. Available online: https://doi.org/10.21227/AW6B-TG17.
77. Assessment of Speech Intelligibility in Parkinson’s Disease Using a Speech-To-Text System10.1109/ACCESS.2017.2762475 ↗
78. Machine Learning Smart System for Parkinson Disease Classification Using the Voice as a Biomarker10.4258/hir.2022.28.3.210 ↗
79. Sound event aware environmental sound segmentation with Mask U-Net10.1080/01691864.2020.1829040 ↗
80. From environmental sound representation to robustness of 2D CNN models against adversarial attacks10.1016/j.apacoust.2022.108817 ↗
81. Kingma, D.P., and Ba, J.L. (2015, January 7–9). Adam: A method for stochastic optimization. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015—Conference Track Proceedings, San Diego, CA, USA.
82. Cardillo, G. (2022, October 01). Clinical Test Performance: The Performance of a Clinical Test Based on the Bayes Theorem. Available online: http://www.mathworks.com/matlabcentral/fileexchange/12705.
83. The use of confidence or fiducial limits illustrated in the case of the Binomial10.1093/biomet/26.4.404 ↗
84. Altman, D., Machin, D., Bryant, T., and Gardner, M. (2000). Statistics with Confidence, BMJ Books. [2nd ed.].
85. Confidence intervals for predictive values with an emphasis to case–control studies10.1002/sim.2677 ↗
86. Methods for Assessing the Credibility of Clinical Trial Outcomes10.1177/009286150103500442 ↗
87. Kreiman, J., and Gerratt, B.R. (2020). Acoustic Analysis and Voice Quality in Parkinson Disease, Springer.10.1007/978-3-030-65654-6_1 ↗
88. The physical significance of acoustic parameters and its clinical significance of dysarthria in Parkinson’s disease10.1038/s41598-020-68754-0 ↗
89. Articulatory undershoot of vowels in isolated REM sleep behavior disorder and early Parkinson’s disease10.1038/s41531-022-00407-7 ↗
90. Moro-Velazquez, L., Gomez-Garcia, J., Dehak, N., and Godino-Llorente, J.I. (2021, January 24–25). New Tools for the Differential Evaluation of Parkinson’s Disease Using Voice and Speech Processing. Proceedings of the IberSPEECH 2021, Valladolid, Spain.10.21437/IberSPEECH.2021-36 ↗
91. Collection and Analysis of a Parkinson Speech Dataset With Multiple Types of Sound Recordings10.1109/JBHI.2013.2245674 ↗
92. A comparative analysis of speech signal processing algorithms for Parkinson’s disease classification and the use of the tunable Q-factor wavelet transform10.1016/j.asoc.2018.10.022 ↗
93. Objective Automatic Assessment of Rehabilitative Speech Treatment in Parkinson’s Disease10.1109/TNSRE.2013.2293575 ↗
94. Orozco-Arroyave, J.R., Arias-Londoño, J.D., Vargas-Bonilla, J.F., González-Rátiva, M.C., and Nöth, E. (2014, January 26–31). New Spanish speech corpus database for the analysis of people suffering from Parkinson’s disease. Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC’14), Reykjavik, Iceland. European Language Resources Association (ELRA).
95. MDS clinical diagnostic criteria for Parkinson’s disease in China10.1007/s00415-016-8370-2 ↗
96. Movement disorder society criteria for clinically established early Parkinson’s disease10.1002/mds.27431 ↗
97. Update of the MDS research criteria for prodromal Parkinson’s disease10.1002/mds.27802 ↗
98. Godino-Llorente, J.I. (2020). Automatic Assessment of Parkinsonian Speech, Springer International Publishing.10.1007/978-3-030-65654-6 ↗
99. Frequency and Cooccurrence of Vocal Tract Dysfunctions in the Speech of a Large Sample of Parkinson Patients10.1044/jshd.4301.47 ↗