Machine Learning Methods with Decision Forests for Parkinson’s Detection
Source abstract
Abstract
Biomedical engineers prefer decision forests over traditional decision trees to design state-of-the-art Parkinson’s Detection Systems (PDS) on massive acoustic signal data. However, the challenges that the researchers are facing with decision forests is identifying the minimum number of decision trees required to achieve maximum detection accuracy with the lowest error rate. This article examines two recent decision forest algorithms Systematically Developed Forest (SysFor), and Decision Forest by Penalizing Attributes (ForestPA) along with the popular Random Forest to design three distinct Parkinson’s detection schemes with optimum number of decision trees. The proposed approach undertakes minimum number of decision trees to achieve maximum detection accuracy. The training and testing samples and the density of trees in the forest are kept dynamic and incremental to achieve the decision forests with maximum capability for detecting Parkinson’s Disease (PD). The incremental tree densities with dynamic training and testing of decision forests proved to be a better approach for detection of PD. The proposed approaches are examined along with other state-of-the-art classifiers including the modern deep learning techniques to observe the detection capability. The article also provides a guideline to generate ideal training and testing split of two modern acoustic datasets of Parkinson’s and control subjects donated by the Department of Neurology in Cerrahpaşa, Istanbul and Departamento de Matemáticas, Universidad de Extremadura, Cáceres, Spain. Among the three proposed detection schemes the Forest by Penalizing Attributes (ForestPA) proved to be a promising Parkinson’s disease detector with a little number of decision trees in the forest to score the highest detection accuracy of 94.12% to 95.00%.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Voice and Speech Disorders · Parkinson's Disease Mechanisms and Treatments
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Applications, Sikkim Manipal Institute of Technology, Sikkim Manipal University, Sikkim 737136, India
Department of Medicine, Sikkim Manipal Institute of Medical Sciences, Sikkim Manipal University, Sikkim 737102, India
Department of Electrical and Electronics Engineering, Sikkim Manipal Institute of Technology, Sikkim Manipal University, Sikkim 737136, India
Institute of Information Science and Technologies, National Research Council, 56124 Pisa, Italy
References (69)
Show source-provided references
1. Dlay, J.K., Duncan, G.W., Khoo, T.K., Williams-Gray, C.H., Breen, D.P., Barker, R.A., Burn, D.J., Lawson, R.A., and Yarnall, A.J. (2020). Progression of Neuropsychiatric Symptoms over Time in an Incident Parkinson’s Disease Cohort (ICICLE-PD). Brain Sci., 10.10.3390/brainsci10020078 ↗
2. Neuropsychiatric symptoms in Alzheimer’s disease10.1016/j.jalz.2011.05.2410 ↗
3. Global, regional, and national life expectancy, all-cause mortality, and cause-specific mortality for 249 causes of death, 1980–2015: A systematic analysis for the Global Burden of Disease Study 201510.1016/S0140-6736(16)31012-1 ↗
4. Brain functional connectivity patterns for emotional state classification in Parkinson’s disease patients without dementia10.1016/j.bbr.2015.10.036 ↗
5. An automatic non-invasive method for Parkinson’s disease classification10.1016/j.cmpb.2017.04.007 ↗
6. Parkinson’s disease classification using gait analysis via deterministic learning10.1016/j.neulet.2016.09.043 ↗
7. Machine Learning Algorithm for Gait Analysis and Classification on Early Detection of Parkinson10.1109/LSENS.2020.2994938 ↗
8. A Wearable, Patient-Adaptive Freezing of Gait Detection System for Biofeedback Cueing in Parkinson’s Disease10.1109/TBCAS.2019.2914253 ↗
9. A comparative analysis of speech signal processing algorithms for Parkinson’s disease classification and the use of the tunable Q-factor wavelet transform10.1016/j.asoc.2018.10.022 ↗
10. Examining multiple feature evaluation and classification methods for improving the diagnosis of Parkinson’s disease10.1016/j.cogsys.2018.12.004 ↗
11. Analysis of Parkinson’s disease data10.1016/j.procs.2018.10.306 ↗
12. Effects of different covariates and contrasts on classification of Parkinson’s disease using structural MRI10.1016/j.compbiomed.2018.05.006 ↗
13. A recurrence plot-based approach for Parkinson’s disease identification10.1016/j.future.2018.11.054 ↗
14. Analysis and evaluation of handwriting in patients with Parkinson’s disease using kinematic, geometrical, and non-linear features10.1016/j.cmpb.2019.03.005 ↗
15. Reliable Parkinson’s Disease Detection by Analyzing Handwritten Drawings: Construction of an Unbiased Cascaded Learning System Based on Feature Selection and Adaptive Boosting Model10.1109/ACCESS.2019.2932037 ↗
16. Variability in fundamental frequency during speech in prodromal and incipient Parkinson’s disease: A longitudinal case study10.1016/j.bandc.2004.05.002 ↗
17. How does parkinsonism start? Prodromal parkinsonism motor changes in idiopathic REM sleep behaviour disorder10.1093/brain/aws093 ↗
18. Quantitative assessment of motor speech abnormalities in idiopathic rapid eye movement sleep behaviour disorder10.1016/j.sleep.2015.07.030 ↗
19. Jeancolas, L., Benali, H., Benkelfat, B.-E., Mangone, G., Corvol, J.-C., Vidailhet, M., Lehericy, S., and Petrovska-Delacretaz, D. (2017, January 22–24). Automatic detection of early stages of Parkinson’s disease through acoustic voice analysis with mel-frequency cepstral coefficients. Proceedings of the 2017 International Conference on Advanced Technologies for Signal and Image Processing (ATSIP), Fez, Morocco.10.1109/ATSIP.2017.8075567 ↗
20. A Diadochokinesis-based expert system considering articulatory features of plosive consonants for early detection of Parkinson’s disease10.1016/j.cmpb.2017.11.010 ↗
21. Automatic Parkinson disease detection at early stages as a pre-diagnosis tool by using classifiers and a small set of vocal features10.1016/j.bbe.2020.01.003 ↗
22. Investigating voice as a biomarker: Deep phenotyping methods for early detection of Parkinson’s disease10.1016/j.jbi.2019.103362 ↗
23. Polat, K. (2019, January 24–26). A hybrid approach to Parkinson disease classification using speech signal: The combination of SMOTE and random forests. Proceedings of the 2019 Scientific Meeting on Electrical-Electronics & Biomedical Engineering and Computer Science (EBBT), Istanbul, Turkey.10.1109/EBBT.2019.8741725 ↗
24. Aich, S., Younga, K., Hui, K.L., Al-Absi, A.A., and Sain, M. (2018, January 11–14). A nonlinear decision tree based classification approach to predict the Parkinson’s disease using different feature sets of voice data. Proceedings of the 2018 20th International Conference on Advanced Communication Technology (ICACT), Chuncheon-si, Korea.10.23919/ICACT.2018.8323863 ↗
25. Adnan, N. (2020, August 22). Decision Tree and Decision Forest Algorithms: On Improving Accuracy, Efficiency and Knowledge Discovery Clustering-Based Recommender System View Project. Available online: https://www.researchgate.net/publication/321474742.
26. Random Forests10.1023/A:1010933404324 ↗
27. Islam, Z., and Giggins, H. (2020, August 21). Knowledge Discovery through SysFor: A Systematically Developed Forest of Multiple Decision Trees Brand Switching in Mobile Phones and Telecommunications View Project A Hybrid Clustering Technique Combining a Novel Genetic Algorithm with K-Means View Project Knowledge Discovery through SysFor-a Systematically Developed Forest of Multiple Decision Trees. Available online: https://www.researchgate.net/publication/236894348.
28. Forest PA: Constructing a decision forest by penalizing attributes used in previous trees10.1016/j.eswa.2017.08.002 ↗
29. Estimation and Statistical Analysis of Human Voice Parameters to Investigate the Influence of Psychological Stress and to Determine the Vocal Tract Transfer Function of an Individual10.1155/2014/290147 ↗
30. Gómez-Rodellar, A., Álvarez-Marquina, A., Mekyska, J., Palacios-Alonso, D., Meghraoui, D., and Gómez-Vilda, P. (2020). Performance of Articulation Kinetic Distributions Vs MFCCs in Parkinson’s Detection from Vowel Utterances. Neural Approaches to Dynamics of Signal Exchanges, Springer.10.1007/978-981-13-8950-4_38 ↗
31. Soumaya, Z., Taoufiq, B.D., Nsiri, B., and Abdelkrim, A. (2019, January 22–25). Diagnosis of Parkinson disease using the wavelet transform and MFCC and SVM classifier. Proceedings of the 2019 4th World Conference on Complex Systems (WCCS), Ouarzazate, Morocco.10.1109/ICoCS.2019.8930802 ↗
32. Drissi, T.B., Zayrit, S., Nsiri, B., and Ammoummou, A. (2019). Diagnosis of Parkinson’s Disease based on Wavelet Transform and Mel Frequency Cepstral Coefficients. Int. J. Adv. Comput. Sci. Appl., 10.10.14569/IJACSA.2019.0100315 ↗
33. Sinnott, R., Duan, H., and Sun, Y. (2016). A Case Study in Big Data Analytics: Exploring Twitter Sentiment Analysis and the Weather. Big Data—Principles and Paradigms, Morgan Kaufmann.10.1016/B978-0-12-805394-2.00015-5 ↗
34. Forest-RK: A new random forest induction method10.1007/978-3-540-85984-0_52 ↗
35. A fuzzy random forest10.1016/j.ijar.2010.02.003 ↗
36. Dynamic Random Forests10.1016/j.patrec.2012.04.003 ↗
37. On dynamic selection of subspace for random forest10.1007/978-3-319-14717-8_29 ↗
38. Disjunctive normal random forests10.1016/j.patcog.2014.08.023 ↗
39. Blaser, R., and Fryzlewicz, P. (2016). Random Rotation Ensembles. J. Mach. Learn. Res.
40. Cutler, A., and Zhao, G. (2020, August 21). PERT-Perfect Random Tree Ensembles. Available online: https://www.researchgate.net/publication/268424569.
41. Automated Diagnosis of Diseases Based on Classification: Dynamic Determination of the Number of Trees in Random Forests Algorithm10.1109/TITB.2011.2175938 ↗
42. Optimizing the number of trees in a decision forest to discover a subforest with high ensemble accuracy using a genetic algorithm10.1016/j.knosys.2016.07.016 ↗
43. Classification of cancer gene selection using random forest and neural network based ensemble classifier
44. Hu, H., Li, J., Wang, H., Daggard, G., and Shi, M. (2020, August 21). A Maximally Diversified Multiple Decision Tree Algorithm for Microarray Data Classification. Available online: http://www.cs.waikato.ac.nz/ml/weka/.
45. Mishra, S., Tripathy, H.K., Mallick, P.K., Bhoi, A.K., and Barsocchi, P. (2020). EAGA-MLP—An Enhanced and Adaptive Hybrid Classification Model for Diabetes Diagnosis. Sensors, 20.10.3390/s20144036 ↗
46. Machine Learning in Medical Imaging10.1109/MSP.2010.936730 ↗
47. Accounting for Label Uncertainty in Machine Learning for Detection of Acute Respiratory Distress Syndrome10.1109/JBHI.2018.2810820 ↗
48. Position Recognition to Support Bedsores Prevention10.1109/TITB.2012.2220374 ↗
49. The Meaning of Sleep Quality: A Survey of Available Technologies10.1109/ACCESS.2019.2953835 ↗
50. Classification and Clustering of Parkinson’s and Healthy Control Gait Dynamics Using LDA and K-means
51. Early Detection of Parkinson’s Disease Using Deep Learning and Machine Learning10.1109/ACCESS.2020.3016062 ↗
52. Deep Learning-Based Parkinson’s Disease Classification Using Vocal Feature Sets10.1109/ACCESS.2019.2936564 ↗
53. Automated Detection of Parkinson’s Disease Based on Multiple Types of Sustained Phonations Using Linear Discriminant Analysis and Genetically Optimized Neural Network10.1109/JTEHM.2019.2940900 ↗
54. Smekal, Z., Mekyska, J., Galaz, Z., Mzourek, Z., Rektorova, I., and Faundez-Zanuy, M. (2015, January 9–10). Analysis of phonation in patients with Parkinson’s disease using empirical mode decomposition. Proceedings of the 2015 International Symposium on Signals, Circuits and Systems (ISSCS), Iasi, Romania.10.1109/ISSCS.2015.7203931 ↗
55. Automated detection of Parkinson’s disease using minimum average maximum tree and singular value decomposition method with vowels10.1016/j.bbe.2019.05.006 ↗
56. Implementation of xgboost for classification of parkinson’s disease
57. Bchir, O. (2020). Parkinson’s Disease Classification using Gaussian Mixture Models with Relevance Feature Weights on Vocal Feature Sets. Int. J. Adv. Comput. Sci. Appl., 11.10.14569/IJACSA.2020.0110456 ↗
58. Cutler, A., Cutler, D.R., and Stevens, J.R. (2012). Random Forests. Ensemble Machine Learning, Springer.10.1007/978-1-4419-9326-7_5 ↗
59. The elements of statistical learning: Data mining, inference and prediction10.1007/BF02985802 ↗
60. Izenman, A.J. (2008). Modern Multivariate Statistical Techniques, Springer.10.1007/978-0-387-78189-1 ↗
61. Zhang, H., and Singer, B.H. (2010). Recursive Partitioning and Applications, Springer.10.1007/978-1-4419-6824-1 ↗
62. Addressing voice recording replications for Parkinson’s disease detection10.1016/j.eswa.2015.10.034 ↗
63. A two-stage variable selection and classification approach for Parkinson’s disease detection by using voice recording replications10.1016/j.cmpb.2017.02.019 ↗
64. Janitza, S., and Hornung, R. (2018). On the overestimation of random forest’s out-of-bag error. PLoS ONE, 13.10.1371/journal.pone.0201904 ↗
65. Oshiro, T.M., Perez, P.S., and Baranauskas, J.A. (2012, January 13–20). How many trees in a random forest?. Proceedings of the International Workshop on Machine Learning and Data Mining in Pattern Recognition, Berlin, Germany.10.1007/978-3-642-31537-4_13 ↗
66. Using Deep Learning Algorithm to Diagnose Parkinson Disease with High Accuracy
67. Semi-Supervised Discriminative Classification Robust to Sample-Outliers and Feature-Noises10.1109/TPAMI.2018.2794470 ↗
68. The WEKA data mining software: An update10.1145/1656274.1656278 ↗
69. Eibe, F., Hall, M., and Witten, I. (2016). The WEKA Workbench. Data Mining: Practical Machine Learning Tools and Techniques, Morgan Kaufmann.