journal article·2023-03-20Open access

Toward Comprehensive Chronic Kidney Disease Prediction Based on Ensemble Deep Learning Models

Deema Mohammed Alsekait, Hager Saleh, Lubna Abdelkareim Gabralla, Khaled Alnowaiser, Shaker El-Sappagh, Radhya Sahal, Nora El-Rashidy

Applied Sciences· Volume 13· Issue 6

Abstract

Chronic kidney disease (CKD) refers to the gradual decline of kidney function over months or years. Early detection of CKD is crucial and significantly affects a patient’s decreasing health progression through several methods, including pharmacological intervention in mild cases or hemodialysis and kidney transportation in severe cases. In the recent past, machine learning (ML) and deep learning (DL) models have become important in the medical diagnosis domain due to their high prediction accuracy. The performance of the developed model mainly depends on choosing the appropriate features and suitable algorithms. Accordingly, the paper aims to introduce a novel ensemble DL approach to detect CKD; multiple methods of feature selection were used to select the optimal selected features. Moreover, we study the effect of the optimal features chosen on CKD from the medical side. The proposed ensemble model integrates pretrained DL models with the support vector machine (SVM) as the metalearner model. Extensive experiments were conducted by using 400 patients from the UCI machine learning repository. The results demonstrate the efficiency of the proposed model in CKD prediction compared to other models. The proposed model with selected features using mutual_info_classi obtained the highest performance.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Artificial Intelligence in Healthcare · Machine Learning in Healthcare · Chronic Kidney Disease and Diabetes

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science and Information Technology, Applied College, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia

Faculty of Computers and Artificial Intelligence, South Valley University, Hurghada 84511, Egypt

College of Computer Engineering and Sciences, Prince Sattam bin Abdulaziz University, Al Kharj 11942, Saudi Arabia

Faculty of Computer Science and Engineering, Galala University, Suez 435611, Egypt

Information Systems Department, Faculty of Computers and Artificial Intelligence, Benha University, Banha 13518, Egypt

School of Computer Science and Information Technology, University College Cork, T12 R229 Cork, Ireland

Machine Learning and Information Retrieval Department, Faculty of Artificial Intelligence, Kafrelsheiksh University, Kafrelsheiksh 13518, Egypt

Funding

Nourah bint Abdulrahman University Researchers

References (76)

Show source-provided references
1. KDIGO 2012 clinical practice guideline for the evaluation and management of chronic kidney disease
2. Epidemiology of chronic kidney disease: An update 202210.1016/j.kisu.2021.11.003 ↗
3. Zhou, Y., and Yang, J. (2020). Chronic Kidney Disease, Springer.10.1007/978-981-32-9131-7_1 ↗
4. Chronic kidney disease: Global dimension and perspectives10.1016/S0140-6736(13)60687-X ↗
5. Automated detection of kidney abnormalities using multi-feature fusion convolutional neural networks10.1016/j.knosys.2020.105873 ↗
6. Swathi, K., and Vamsi Krishna, G. (2023). Smart Technologies in Data Science and Communication: Proceedings of SMART-DSC 2022, Springer.
7. Epidemiology and risk of cardiovascular disease in populations with chronic kidney disease10.1038/s41581-022-00616-6 ↗
8. Early recognition and prevention of chronic kidney disease10.1016/S0140-6736(09)62004-3 ↗
9. Ma, F., Gao, J., Suo, Q., You, Q., Zhou, J., and Zhang, A. (2018, January 19–23). Risk prediction on electronic health records with prior medical knowledge. Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, London, UK.10.1145/3219819.3220020 ↗
10. A dynamic pooling based convolutional neural network approach to detect chronic kidney disease10.1016/j.bspc.2020.102068 ↗
11. Sepsis prediction in intensive care unit based on genetic feature optimization and stacked deep ensemble learning10.1007/s00521-021-06631-1 ↗
12. Jayanthi, P. (2022). Deep Learning for Medical Applications with Unique Data, Elsevier.
13. Sun, Q., and Pfahringer, B. (2012, January 4–7). Bagging ensemble selection for regression. Proceedings of the AI 2012: Advances in Artificial Intelligence: 25th Australasian Joint Conference, Sydney, Australia. Proceedings 25.
14. Odegua, R. (2019, January 25–31). An empirical study of ensemble techniques (bagging, boosting and stacking). Proceedings of the Deep Learning IndabaX, Nairobi, Kenya.
15. Application of bagging ensemble model for predicting compressive strength of hollow concrete masonry prism10.1016/j.asej.2021.03.028 ↗
16. Feature Selection Methods: Case of Filter and Wrapper Approaches for Maximising Classification Accuracy
17. Rabby, A.S.A., Mamata, R., Laboni, M.A., and Abujar, S. (2019, January 3–5). Machine learning applied to kidney disease prediction: Comparison study. Proceedings of the 2019 IEEE 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT), Kharagpur, India.10.1109/ICCCNT45670.2019.8944799 ↗
18. Walse, R.S., Kurundkar, G.D., Khamitkar, S.D., Muley, A.A., Bhalchandra, P.U., and Lokhande, S.N. (2020, January 15–16). Effective Use of Naïve Bayes, Decision Tree, and Random Forest Techniques for Analysis of Chronic Kidney Disease. Proceedings of the International Conference on Information and Communication Technology for Intelligent Systems, Ahmedabad, India.10.1007/978-981-15-7078-0_22 ↗
19. Moreno-Sanchez, P.A. (2021, January 24–26). Chronic Kidney Disease Early Diagnosis Enhancing by Using Data Mining Classification and Features Selection. Proceedings of the International Conference on IoT Technologies for HealthCare, Virtual Event.10.1007/978-3-030-69963-5_5 ↗
20. Detection of chronic kidney disease with laboratory reporting of estimated glomerular filtration rate and an educational program10.1001/archinte.164.16.1788 ↗
21. Chronic kidney disease in older people10.1001/jama.2015.6753 ↗
22. Al Imran, A., Amin, M.N., and Johora, F.T. (2018, January 27–28). Classification of chronic kidney disease using logistic regression, feedforward neural network and wide & deep learning. Proceedings of the 2018 International Conference on Innovation in Engineering and Technology (ICIET), IEEE, Dhaka, Bangladesh.10.1109/CIET.2018.8660844 ↗
23. Hassan, M.M., Hassan, M.M., Mollick, S., Khan, M.A.R., Yasmin, F., Bairagi, A.K., Raihan, M., Arif, S.A., and Rahman, A. (2023). A Comparative Study, Prediction and Development of Chronic Kidney Disease Using Machine Learning on Patients Clinical Records. Hum.-Cent. Intell. Syst., 1–13.10.1007/s44230-023-00017-3 ↗
24. Diagnosis of chronic kidney disease using effective classification algorithms and recursive feature elimination techniques10.1155/2021/1004767 ↗
25. Poonia, R.C., Gupta, M.K., Abunadi, I., Albraikan, A.A., Al-Wesabi, F.N., and Hamza, M.A. (2022). Intelligent diagnostic prediction and classification models for detection of kidney disease. Healthcare, 10.10.3390/healthcare10020371 ↗
26. Ilyas, H., Ali, S., Ponum, M., Hasan, O., Mahmood, M.T., Iftikhar, M., and Malik, M.H. (2021). Chronic kidney disease diagnosis using decision tree algorithms. BMC Nephrol., 22.10.1186/s12882-021-02474-z ↗
27. Swain, D., Mehta, U., Bhatt, A., Patel, H., Patel, K., Mehta, D., Acharya, B., Gerogiannis, V.C., Kanavos, A., and Manika, S. (2023). A Robust Chronic Kidney Disease Classifier Using Machine Learning. Electronics, 12.10.3390/electronics12010212 ↗
28. Mondol, C., Shamrat, F.J.M., Hasan, M.R., Alam, S., Ghosh, P., Tasnim, Z., Ahmed, K., Bui, F.M., and Ibrahim, S.M. (2022). Early Prediction of Chronic Kidney Disease: A Comprehensive Performance Analysis of Deep Learning Models. Algorithms, 15.10.3390/a15090308 ↗
29. A comparative assessment of artificial intelligence models used for early prediction and evaluation of chronic kidney disease10.1016/j.dajour.2023.100169 ↗
30. A machine learning methodology for diagnosing chronic kidney disease10.1109/ACCESS.2019.2963053 ↗
31. A comprehensive analysis on detecting chronic kidney disease by employing machine learning algorithms10.4108/eai.13-8-2021.170671 ↗
32. Shamrat, F.J.M., Ghosh, P., Sadek, M.H., Kazi, M.A., and Shultana, S. (2020, January 6–8). Implementation of machine learning algorithms to detect the prognosis rate of kidney disease. Proceedings of the 2020 IEEE International Conference for Innovation in Technology (INOCON), Bangalore, India.
33. Chronic Kidney Disease Prediction Using Machine Learning Techniques
34. A hybrid neural network model for predicting kidney disease in hypertension patients based on electronic health records10.1186/s12911-019-0765-4 ↗
35. Krishnamurthy, S., Kapeleshh, K., Dovgan, E., Luštrek, M., Gradišek Piletič, B., Srinivasan, K., Li, Y.C., Gradišek, A., and Syed-Abdul, S. (2020). Machine learning prediction models for chronic kidney disease using national health insurance claim data in Taiwan. medRxiv.10.1101/2020.06.25.20139147 ↗
36. Robust clinical marker identification for diabetic kidney disease with ensemble feature selection10.1093/jamia/ocy165 ↗
37. Prediction of kidney-related outcomes in patients with type 2 diabetes10.1053/j.ajkd.2012.04.025 ↗
38. (2023, February 08). Chronic KIdney Disease Dataset. Available online: https://archive.ics.uci.edu/ml/datasets/Chronic_Kidney_Disease.
39. Intelligent diagnostic prediction and classification system for chronic kidney disease10.1038/s41598-019-46074-2 ↗
40. Computerized home video detection for motherese may help to study impaired interaction between infants who become autistic and their parents10.1002/mpr.332 ↗
41. The expectation-maximization algorithm10.1109/79.543975 ↗
42. Analyzing outliers: Robust methods to the rescue10.1038/s41592-019-0369-z ↗
43. Yu, L., and Liu, H. (2003, January 21–24). Feature selection for high-dimensional data: A fast correlation-based filter solution. Proceedings of the 20th International Conference on Machine Learning, Washington, DC, USA.
44. An introduction to variable and feature selection
45. A review of feature selection and its methods
46. (2023, February 08). Chi-Squared. Available online: https://scikit-learn.org/stable/modules/generated/sklearn.feature_selection.chi2.html.
47. (2023, February 08). Mutual Information. Available online: https://scikit-learn.org/stable/modules/generated/sklearn.feature_selection.mutual_info_classif.html.
48. Lin, X., Li, C., Zhang, Y., Su, B., Fan, M., and Wei, H. (2017). Selecting feature subsets based on SVM-RFE and the overlapping ratio with applications in bioinformatics. Molecules, 23.10.3390/molecules23010052 ↗
49. A fuzzy gaussian rank aggregation ensemble feature selection method for microarray data
50. Savić, M., Kurbalija, V., Ivanović, M., and Bosnić, Z. (2017, January 4–6). A feature selection method based on feature correlation networks. Proceedings of the Model and Data Engineering: 7th International Conference (MEDI 2017), Barcelona, Spain. Proceedings 7.
51. Feature selection for unsupervised learning
52. Zhang, Z. (2018, January 4–6). Improved adam optimizer for deep neural networks. Proceedings of the 2018 IEEE/ACM 26th International Symposium on Quality of Service (IWQoS), IEEE, Banff, AB, Canada.10.1109/IWQoS.2018.8624183 ↗
53. Use of binary sigmoid function and linear identity in artificial neural networks for forecasting population density
54. Basili, R., and Croce, D. (2008). Recurrent Neural Networks, IntechOpen.
55. Skansi, S. (2018). Introduction to Deep Learning: From Logical Calculus to Artificial Intelligence, Springer.10.1007/978-3-319-73004-2 ↗
56. Chung, J., Gulcehre, C., Cho, K., and Bengio, Y. (2015, January 6–11). Gated feedback recurrent neural networks. Proceedings of the International Conference on Machine Learning, PMLR, Lille, France.
57. Keras tuner
58. Krishnamurthy, S., Ks, K., Dovgan, E., Luštrek, M., Gradišek Piletič, B., Srinivasan, K., Li, Y.C., Gradišek, A., and Syed-Abdul, S. (2021). Machine learning prediction models for chronic kidney disease using national health insurance claim data in Taiwan. Healthcare, 9.10.3390/healthcare9050546 ↗
59. Evaluating explainable artificial intelligence methods for multi-label deep learning classification tasks in remote sensing
60. Gulum, M.A., Trombley, C.M., and Kantardzic, M. (2021). A review of explainable deep learning cancer detection models in medical imaging. Appl. Sci., 11.10.3390/app11104573 ↗
61. Hemoglobin level, chronic kidney disease, and the risks of death and hospitalization in adults with chronic heart failure: The Anemia in Chronic Heart Failure: Outcomes and Resource Utilization (ANCHOR) Study10.1161/CIRCULATIONAHA.105.577577 ↗
62. Evidence for optimal hemoglobin targets in chronic kidney disease
63. Effects of packed cell volume reduction on renal haemodynamics and the renin-angiotensin-aldosterone system in patients with secondary polycythaemia and hypoxic cor pulmonale10.1042/cs0700081 ↗
64. Evaluation of the serum cystatin C values in prediction of indications for hemodialysis in patients with chronic renal failure10.1007/s11255-013-0481-4 ↗
65. Assessment of Red Blood Cell Indices, White Blood Cells, Platelet Indices and Procalcitonin of Chronic Kidney Disease Patients under Hemodialysis
66. Acute kidney injury: Diagnosis and management10.1007/s12098-019-03096-y ↗
67. Kelly, C.J., Brown, A.P., and Taylor, J.A. (2020). Artificial Intelligence in Medicine, Springer.10.1007/978-3-030-58080-3_316-1 ↗
68. Diagnosis and management of type 2 diabetic kidney disease10.2215/CJN.11111016 ↗
69. Albumin contributes to kidney disease progression in Alport syndrome10.1152/ajprenal.00456.2015 ↗
70. Association of serum albumin levels with kidney function decline and incident chronic kidney disease in elders10.1093/ndt/gfx229 ↗
71. The Relastionship between sodium, potassium, and hypothroidism in Chronic Kidney Disease (CKD) patients10.15562/bmj.v8i1.1344 ↗
72. Gentile, G., Mckinney, K., and Reboldi, G. (2022). Tight blood pressure control in chronic kidney disease. J. Cardiovasc. Dev. Dis., 9.10.3390/jcdd9050139 ↗
73. Infection rate and acute organ dysfunction risk as explanations for racial differences in severe sepsis10.1001/jama.2010.851 ↗
74. Overview of urea and creatinine10.1309/LM920SBNZPJRJGUT ↗
75. Biomarkers of drug-induced kidney toxicity10.1097/FTD.0000000000000589 ↗
76. Kidney function tests