journal article·2022-04-06Open access

Exploring Early Prediction of Chronic Kidney Disease Using Machine Learning Algorithms for Small and Imbalanced Datasets

Andressa C. M. da Silveira, Álvaro Sobrinho, Leandro Dias da Silva, Evandro de Barros Costa, Maria Eliete Pinheiro, Angelo Perkusich

Applied Sciences· Volume 12· Issue 7

Abstract

Chronic kidney disease (CKD) is a worldwide public health problem, usually diagnosed in the late stages of the disease. To alleviate such issue, investment in early prediction is necessary. The purpose of this study is to assist the early prediction of CKD, addressing problems related to imbalanced and limited-size datasets. We used data from medical records of Brazilians with or without a diagnosis of CKD, containing the following attributes: hypertension, diabetes mellitus, creatinine, urea, albuminuria, age, gender, and glomerular filtration rate. We present an oversampling approach based on manual and automated augmentation. We experimented with the synthetic minority oversampling technique (SMOTE), Borderline-SMOTE, and Borderline-SMOTE SVM. We implemented models based on the algorithms: decision tree (DT), random forest, and multi-class AdaBoosted DTs. We also applied the overall local accuracy and local class accuracy methods for dynamic classifier selection; and the k-nearest oracles-union, k-nearest oracles-eliminate, and META-DES for dynamic ensemble selection. We analyzed the models’ performances using the hold-out validation, multiple stratified cross-validation (CV), and nested CV. The DT model presented the highest accuracy score (98.99%) using the manual augmentation and SMOTE. Our approach can assist in designing systems for the early prediction of CKD using imbalanced and limited-size datasets.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Artificial Intelligence in Healthcare · Imbalanced Data Classification Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Electrical Engineering Department, Federal University of Campina Grande, Campina Grande 58428-830, Brazil

Computer Science, Federal University of the Agreste of Pernambuco, Garanhuns 55292-270, Brazil

Computing Institute, Federal University of Alagoas, Maceió 57072-900, Brazil

Faculty of Medicine, Federal University of Alagoas, Maceió 57072-900, Brazil

Virtus Research, Development and Innovation Center, Federal University of Campina Grande, Campina Grande 58428-830, Brazil

References (54)

Show source-provided references
1. Global, regional, and national burden of chronic kidney disease, 1990–2017: A systematic analysis for the global burden of disease study 201710.1016/S0140-6736(20)30045-3 ↗
2. Abegunde, D., and Stanciole, A. (2006). Preventing Chronic Diseases: A Vital Investment: Who Global Report.
3. World Health Organization (2019). World Health Statistics Overview 2019: Monitoring Health for the SDGS, Sustainable Development Goals.
4. Sociedade Brasileira de Diabetes (2019). Guidelines of the Brazilian Society of Diabetes 2019–2020, Sociedade Brasileira de Diabetes.
5. Computer-aided diagnosis of chronic kidney disease in developing countries: A comparative analysis of machine learning techniques10.1109/ACCESS.2020.2971208 ↗
6. Chronic kidney disease in older people10.1001/jama.2015.6753 ↗
7. Concepts in diabetic nephropathy: From pathophysiology to treatment10.15586/jrenhep.2017.17 ↗
8. Brazilian dialysis census 200910.1590/S0101-28002010000400007 ↗
9. Chronic kidney disease10.1016/S0140-6736(16)32064-5 ↗
10. 2010 report of the brazilian dialysis census10.1590/S0101-28002011000400009 ↗
11. Brazilian chronic dialysis survey 201610.5935/0101-2800.20170049 ↗
12. Brazilian chronic dialysis survey 201710.1590/2175-8239-jbn-2018-0178 ↗
13. Brazilian dialysis census: Analysis of data from the 2009–2018 decade10.1590/2175-8239-jbn-2019-0234 ↗
14. Dialysis initiation, modality choice, access, and prescription: Conclusions from a Kidney Disease: Improving Global Outcomes (KDIGO) Controversies Conference10.1016/j.kint.2019.01.017 ↗
15. Elshahat, S., Cockwell, P., Maxwell, A.P., Griffin, M., O’Brien, T., and O’Neill, C. (2020). The impact of chronic kidney disease on developed countries from a health economics perspective: A systematic scoping review. PLoS ONE, 15.10.1371/journal.pone.0230512 ↗
16. (2020, April 01). Brazilian Ministry of Health. Available online: https://bit.ly/3uNAS3Y.
17. Ckdnet, a quality improvement project for prevention and reduction of chronic kidney disease in the northeast Thailand
18. Vabalas, A., Gowen, E., Poliakoff, E., and Casson, A.J. (2019). Machine learning algorithm validation with a limited sample size. PLoS ONE, 14.10.1371/journal.pone.0224365 ↗
19. Classification of imbalanced data: A review10.1142/S0218001409007326 ↗
20. Jeni, L.A., Cohn, J.F., and De La Torre, F. (2013, January 2–5). Facing imbalanced data–recommendations for the use of performance metrics. Proceedings of the 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, Geneva, Switzerland.10.1109/ACII.2013.47 ↗
21. Making a big impact with small datasets using machine-learning approaches10.1016/S2665-9913(20)30217-4 ↗
22. DESlib: A Dynamic ensemble selection library in Python
23. General framework for class-specific feature selection10.1016/j.eswa.2011.02.016 ↗
24. Hulse, J.V., Khoshgoftaar, T.M., and Napolitano, A. (2007, January 20–24). Experimental perspectives on learning from imbalanced data. Proceedings of the 24th International Conference on Machine Learning, Corvallis, OR, USA.
25. Akbani, R., Kwek, S., and Japkowicz, N. (2004, January 20–24). Applying support vector machines to imbalanced datasets. Proceedings of the European Conference on Machine Learning, Pisa, Italy.10.1007/978-3-540-30115-8_7 ↗
26. Bias in error estimation when using cross-validation for model selection10.1186/1471-2105-7-91 ↗
27. Classification Models for COVID-19 Test Prioritization in Brazil: Machine Learning Approach10.2196/27293 ↗
28. Design and evaluation of a mobile application to assist the self-monitoring of the chronic kidney disease in developing countries
29. The kidney disease improving global outcomes (KDIGO) guideline update for chronic kidney disease: Evolution not revolution10.1373/clinchem.2012.184259 ↗
30. Chronic kidney disease in adults: Assessment and management10.7861/clinmed.cg.20.2 ↗
31. KDOQI US commentary on the 2012 KDIGO clinical practice guideline for the evaluation and management of CKD10.1053/j.ajkd.2014.01.416 ↗
32. Sobrinho, A., da Silva, L.D., Perkusich, A., Queiroz, A., and Pinheiro, M.E. (2022, April 01). A Brazilian Dataset for Screening the Risk of the Chronic Kidney Disease. Available online: https://bit.ly/3rQxllg.
33. Imbalanced-learn: Apython toolbox to tackle the curse of imbalanced datasets in machine learning
34. SMOTE: Synthetic minority over-sampling technique10.1613/jair.953 ↗
35. Han, H., Wang, W.-Y., and Mao, B.-H. (2005, January 23–26). Borderline-smote: A new over-sampling method in imbalanced datasets learning. Proceedings of the International Conference on Intelligent Computing, Hefei, China.10.1007/11538059_91 ↗
36. Borderline over-sampling for imbalanced data classification10.1504/IJKESDP.2011.039875 ↗
37. Bishop, C.M. (2011). Pattern Recognition and Machine Learning, Springer. [2nd ed.].
38. Detecting stable distributed patterns of brain activation using gini contrast10.1016/j.neuroimage.2010.07.074 ↗
39. Scikit-learn: Machine learning in Python
40. Boughorbel, S., Jarray, F., and El-Anbari, M. (2017). Optimal classifier for imbalanced data using Matthews Correlation Coefficient metric. PLoS ONE, 12.10.1371/journal.pone.0177678 ↗
41. A Method for Comparing Two Hierarchical Clusterings10.1080/01621459.1983.10478008 ↗
42. A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems10.1023/A:1010920819831 ↗
43. Davis, J., and Goadrich, M. (2006, January 25–29). The relationship between Precision-Recall and ROC curves. Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, PA, USA.10.1145/1143844.1143874 ↗
44. Wang, H.Y. (2008, January 1–6). Combination approach of SMOTE and biased-SVM for imbalanced datasets. Proceedings of the IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), Hong Kong, China.10.1109/IJCNN.2008.4633794 ↗
45. Chawla, N.V., Lazarevic, A., Hall, L.O., and Bowyer, K.W. (2003, January 19–23). SMOTEBoost: Improving Prediction of the Minority Class in Boosting. Proceedings of the European Conference on Principles of Data Mining and Knowledge Discovery, Helsinki, Finland.10.1007/978-3-540-39804-2_12 ↗
46. RACOG and wRACOG: Two Probabilistic Oversampling Techniques10.1109/TKDE.2014.2324567 ↗
47. Cross-validation failure: Small sample sizes lead to large error bars10.1016/j.neuroimage.2017.06.061 ↗
48. Cross-validation pitfalls when selecting and assessing regression and classification models10.1186/1758-2946-6-10 ↗
49. Chronic kidney disease diagnosis using decision tree algorithms10.1186/s12882-021-02474-z ↗
50. A Machine Learning Methodology for Diagnosing Chronic Kidney Disease10.1109/ACCESS.2019.2963053 ↗
51. Prediction of Chronic Kidney Disease—A Machine Learning Perspective10.1109/ACCESS.2021.3053763 ↗
52. Chaurasia, V., Pandey, M.K., and Pal, S. (2022). Chronic kidney disease: A prediction and comparison of ensemble and basic classifiers performance. Hum. Intell. Syst. Integr., 1–10.10.1007/s42454-022-00040-y ↗
53. Abdulaal, M., Casson, A., and Gaydecki, P. (2018, January 3–7). Performance of Nested vs. Non-nested SVM Cross-validation Methods in Visual BCI: Validation Study. Proceedings of the 2018 26rd European Signal Processing Conference (EUSIPCO), Rome, Italy.10.23919/EUSIPCO.2018.8553102 ↗
54. (2022, April 01). CKD-Experiment. Available online: https://bit.ly/3BpnsOw.