journal article·2022-01-18Open access

Fine-Tuning Fuzzy KNN Classifier Based on Uncertainty Membership for the Medical Diagnosis of Diabetes

Hanaa Salem, Mahmoud Y. Shams, Omar M. Elzeki, Mohamed Abd Elfattah, Jehad F. Al-Amri, Shaima Elnazer

Applied Sciences· Volume 12· Issue 3

Abstract

Diabetes, a metabolic disease in which the blood glucose level rises over time, is one of the most common chronic diseases at present. It is critical to accurately predict and classify diabetes to reduce the severity of the disease and treat it early. One of the difficulties that researchers face is that diabetes datasets are limited and contain outliers and missing data. Additionally, there is a trade-off between classification accuracy and operational law for detecting diabetes. In this paper, an algorithm for diabetes classification is proposed for pregnant women using the Pima Indians Diabetes Dataset (PIDD). First, a preprocessing step in the proposed algorithm includes outlier rejection, imputing missing values, the standardization process, and feature selection of the attributes, which enhance the dataset’s quality. Second, the classifier uses the fuzzy KNN method and modifies the membership function based on the uncertainty theory. Third, a grid search method is applied to achieve the best values for tuning the fuzzy KNN method based on uncertainty membership, as there are hyperparameters that affect the performance of the proposed classifier. In turn, the proposed tuned fuzzy KNN based on uncertainty classifiers (TFKNN) deals with the belief degree, handles membership functions and operation law, and avoids making the wrong categorization. The proposed algorithm performs better than other classifiers that have been trained and evaluated, including KNN, fuzzy KNN, naïve Bayes (NB), and decision tree (DT). The results of different classifiers in an ensemble could significantly improve classification precision. The TFKNN has time complexity O(kn2d), and space complexity O(n2d). The TFKNN model has high performance and outperformed the others in all tests in terms of accuracy, specificity, precision, and average AUC, with values of 90.63, 85.00, 93.18, and 94.13, respectively. Additionally, results of empirical analysis of TFKNN compared to fuzzy KNN, KNN, NB, and DT demonstrate the global superiority of TFKNN in precision, accuracy, and specificity.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Artificial Intelligence in Healthcare · Imbalanced Data Classification Techniques · Data Mining Algorithms and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Engineering, Delta University for Science and Technology, Gamasa 35712, Egypt

Faculty of Artificial Intelligence, Kafrelsheikh University, Kafrelsheikh 33511, Egypt

Faculty of Computers and Information, Mansoura University, Mansoura 35516, Egypt

Computer Science Department, Misr Higher Institute for Commerce and Computers, Mansoura 35511, Egypt

Department of Information Technology, College of Computers and Information Technology, Taif University, P. O. Box 11099, Taif 21944, Saudi Arabia

Nile Higher Institute for Engineering and Technology, Mansoura 35524, Egypt

References (57)

Show source-provided references
1. Role of cadmium and arsenic as endocrine disruptors in the metabolism of carbohydrates: Inserting the association into perspectives10.1016/j.biopha.2019.108802 ↗
2. Diabetes trends in the US: 1990–199810.2337/diacare.23.9.1278 ↗
3. Yan, K., and Lu, H. (2018, January 19–21). An extended genetic algorithm based gene selection framework for cancer diagnosis. Proceedings of the 2018 9th International Conference on Information Technology in Medicine and Education (ITME), Hangzhou, China.10.1109/ITME.2018.00021 ↗
4. Type 2 diabetes and cardiovascular disease: Have all risk factors the same strength?10.4239/wjd.v5.i4.444 ↗
5. Chaki, J., Ganesh, S.T., Cidham, S., and Theertan, S.A. (2020). Machine learning and artificial intelligence based Diabetes Mellitus detection and self-management: A systematic review. J. King Saud Univ.-Comput. Inf. Sci.
6. Classification based on fuzzy robust PCA algorithms and similarity classifier10.1016/j.eswa.2008.09.015 ↗
7. Joint use of eddy current imaging and fuzzy similarities to assess the integrity of steel plates10.1515/phys-2020-0159 ↗
8. Comparative anatomization of data mining and fuzzy logic techniques used in diabetes prognosis10.1016/j.ceh.2020.11.001 ↗
9. Smart city lifestyle sensing, big data, geo-analytics and intelligence for smarter public health decision-making in overweight, obesity and type 2 diabetes prevention: The research we should be doing
10. IoT-based telemedicine for disease prevention and health promotion: State-of-the-Art10.1016/j.jnca.2020.102873 ↗
11. The use of statins in people at risk of developing diabetes mellitus: Evidence and guidance for clinical practice10.1016/j.atherosclerosissup.2014.04.001 ↗
12. Statin use and risk of developing diabetes: Results from the Diabetes Prevention Program10.1136/bmjdrc-2017-000438 ↗
13. Gestational diabetes mellitus10.1038/s41572-019-0098-8 ↗
14. Gestational diabetes mellitus10.2337/diacare.27.2007.S88 ↗
15. IDF Diabetes Atlas: Global estimates of diabetes prevalence for 2017 and projections for 204510.1016/j.diabres.2018.02.023 ↗
16. World Health Organization (2018). Continuity and Coordination of Care: A Practice Brief to Support Implementation of the WHO Framework on Integrated People-Centred Health Services, World Health Organization.
17. Yager, R.R., and Zadeh, L.A. (2012). An Introduction to Fuzzy Logic Applications in Intelligent Systems, Springer Science & Business Media.
18. An integrated multi-node Hadoop framework to predict high-risk factors of Diabetes Mellitus using a Multilevel MapReduce based Fuzzy Classifier (MMR-FC) and Modified DBSCAN algorithm10.1016/j.asoc.2021.107423 ↗
19. Machine Learning and Data Mining Methods in Diabetes Research10.1016/j.csbj.2016.12.005 ↗
20. Machine learning techniques for medical diagnosis of diabetes using iris images10.1016/j.cmpb.2018.01.004 ↗
21. Ganesh, P.S., and Sripriya, P. (2019, January 25–26). A comparative review of prediction methods for pima indians diabetes dataset. Proceedings of the International Conference on Computational Vision and Bio Inspired Computing, Coimbatore, India.
22. A fuzzy-ontology-oriented case-based reasoning framework for semantic diabetes diagnosis10.1016/j.artmed.2015.08.003 ↗
23. Prediction of diabetes using classification algorithms10.1016/j.procs.2018.05.122 ↗
24. Application of Genetic Algorithm Optimized Neural Network Connection Weights for Medical Diagnosis of PIMA Indians Diabetes10.5121/ijsc.2011.2202 ↗
25. Sequential Minimal Optimization for Predicting Diabetes at its Early Stage
26. Prediction of Diabetes in Females of Pima Indian Heritage: A Complete Supervised Learning Approach
27. Benbelkacem, S., and Atmani, B. (2019, January 3–4). Random forests for diabetes diagnosis. Proceedings of the 2019 International Conference on Computer and Information Sciences (ICCIS), Aljouf, Saudi Arabia.10.1109/ICCISci.2019.8716405 ↗
28. Meng, Y., Lu, H., Yan, K., and Ye, M. (2017, January 22–23). Hybrid Adaboost based on Genetic Algorithm for Gene Expression Data Classification. Proceedings of the 12th Chinese Conference on Computer Supported Cooperative Work and Social Computing, Chongqing, China.10.1145/3127404.3127466 ↗
29. A remote healthcare monitoring framework for diabetes prediction using machine learning10.1049/htl2.12010 ↗
30. Feature optimization using Backward Elimination and Support Vector Machines (SVM) algorithm for diabetes classification10.1088/1742-6596/1821/1/012006 ↗
31. Hrimov, A., Meniailov, I., Chumachenko, D., Bazilevych, K., and Chumachenko, T. (2020, January 28–30). Classification of Diabetes Disease Using Logistic Regression Method. Proceedings of the Conference on Integrated Computer Technologies in Mechanical Engineering–Synergetic Engineering, Kharkiv, Ukraine.10.1007/978-3-030-66717-7_13 ↗
32. An improved early detection method of type-2 diabetes mellitus using multiple classifier system10.1016/j.ins.2014.08.056 ↗
33. Diabetes detection using deep learning techniques with oversampling and feature augmentation10.1016/j.cmpb.2021.105968 ↗
34. Deep learning approach for diabetes prediction using PIMA Indian dataset10.1007/s40200-020-00520-5 ↗
35. Dropout: A simple way to prevent neural networks from overfitting
36. Diabetes Prediction: A Deep Learning Approach
37. Xie, J., Girshick, R., and Farhadi, A. (2016, January 20–22). Unsupervised deep embedding for clustering analysis. Proceedings of the International Conference on Machine Learning (PMLR), New York, NY, USA.
38. Laaksonen, J., and Oja, E. (1996, January 3–6). Classification with learning k-nearest neighbors. Proceedings of the International Conference on Neural Networks (ICNN’96), Washington, DC, USA.10.1109/ICNN.1996.549118 ↗
39. Andoni, A., and Indyk, P. (2006, January 21–24). Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions. Proceedings of the 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS’06), Berkeley, CA, USA.10.1109/FOCS.2006.49 ↗
40. Fast exact k nearest neighbors search using an orthogonal search tree10.1016/j.patcog.2010.01.003 ↗
41. Enhancing evolutionary instance selection algorithms by means of fuzzy rough set based feature selection10.1016/j.ins.2011.09.027 ↗
42. Prototype Selection for Nearest Neighbor Classification: Taxonomy and Empirical Study10.1109/TPAMI.2011.142 ↗
43. Improving the accuracy of k-nearest neighbor using local mean based and distance weight10.1088/1742-6596/978/1/012047 ↗
44. A method to improve the accuracy of k-nearest neighbor algorithm
45. Bahanshal, S., and Kim, B. (2020, January 1–4). Hybrid Fuzzy Weighted K-Nearest Neighbor to Predict Hospital Readmission for Diabetic Patients. Proceedings of the 2020 IEEE Symposium Series on Computational Intelligence (SSCI), Canberra, Australia.10.1109/SSCI47803.2020.9308286 ↗
46. An Improved Fuzzy K-Nearest Neighbor Algorithm for Imbalanced Data using Adaptive Approach10.1080/03772063.2018.1462109 ↗
47. Fuzzy nearest neighbor algorithms: Taxonomy, experimental analysis and prospects10.1016/j.ins.2013.10.038 ↗
48. A learning scheme for a fuzzy k-NN rule10.1016/0167-8655(83)90064-8 ↗
49. A fuzzy K-nearest neighbor algorithm10.1109/TSMC.1985.6313426 ↗
50. Efficient treatment of outliers and class imbalance for diabetes prediction10.1016/j.artmed.2020.101815 ↗
51. Outliers detection and treatment: A review10.21500/20112084.844 ↗
52. A Review of Feature Selection and Its Methods
53. Diabetes Prediction Using Ensembling of Different Machine Learning Classifiers10.1109/ACCESS.2020.2989857 ↗
54. Design ensemble machine learning model for breast cancer diagnosis10.1007/s10916-011-9762-6 ↗
55. Skin lesion classification with ensembles of deep convolutional neural networks10.1016/j.jbi.2018.08.006 ↗
56. Yan, K., and Lu, H. (2019). Evaluating ensemble learning impact on gene selection for automated cancer diagnosis. Precision Health and Medicine, Springer.10.1007/978-3-030-24409-5_18 ↗
57. An experimental comparison of cross-validation techniques for estimating the area under the ROC curve10.1016/j.csda.2010.11.018 ↗