Transfer Learning for Diabetic Retinopathy Detection: A Study of Dataset Combination and Model Performance
Source abstract
Abstract
Diabetes’ serious complication, diabetic retinopathy (DR), which can potentially be life-threatening, might result in vision loss in certain situations. Although it has no symptoms in the early stages, this illness is regarded as one of the “silent diseases” that go unnoticed. The fact that various datasets have varied retinal features is one of the significant difficulties in this field of study. This information impacts the models created for this purpose. This study’s method can efficiently learn and classify DR from three diverse datasets. Four models based on transfer learning Convolution Neural Network (CNN)—Visual Geometry Group (VGG) 16, Inception version 3 (InceptionV3), Dense Network (DenseNet) 121, and Mobile Network version 2 (MobileNetV2)—are employed in this work, with evaluation parameters, including loss, accuracy, recall, precision, and specificity. The models are also tested by combining the images from the three datasets. The DenseNet121 model performs better with 98.97% accuracy on the combined image set. The study concludes that combining multiple datasets improves performance compared to individual datasets. The obtained model can be utilized globally to accommodate more tests that clinics perform for diabetic patients to prevent DR. It helps health workers refer patients to ophthalmologists before DR becomes serious.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Retinal Imaging and Analysis · Retinal Diseases and Treatments · Retinal and Optic Conditions
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Engineering, College of Engineering and Petroleum, Kuwait University, P.O. Box 5969, Safat 13060, Kuwait
Funding
Kuwait University Research
References (82)
Show source-provided references
1. Diabetic retinopathy: Role of neurodegeneration and therapeutic perspectives10.1097/APO.0000000000000510 ↗
2. World Health Organization (2022, November 21). Diabetes. Available online: https://www.who.int/news-room/fact-sheets/detail/diabetes.
3. IDF Diabetes Atlas: Global, regional and country-level diabetes prevalence estimates for 2021 and projections for 204510.1016/j.diabres.2021.109119 ↗
4. Rajini, H.N. (2019, January 15–16). A Novel Approachfor the Diagnosis of Diabetic Retinopathy Using Convolutional Neural Network. Proceedings of the 2019 5th International Conference on Advanced Computing & Communication Systems (ICACCS), Coimbatore, India.10.1109/ICACCS.2019.8728506 ↗
5. A data-driven approach to referable diabetic retinopathy detection10.1016/j.artmed.2019.03.009 ↗
6. Sesikala, B., Harikiran, J., and SaiChandana, B. (2022, January 28–30). A Study on Diabetic Retinopathy Detection, Segmentation and Classification Using Deep and Machine Learning Techniques. Proceedings of the 2022 6th International Conference on Trends in Electronics and Informatics (ICOEI), Tirunelveli, India.10.1109/ICOEI53556.2022.9776690 ↗
7. Sri, K.S., Priya, G.K., Kumar, B.P., Sravya, S.D., and Priya, M.B. (2022, January 28–30). Diabetic Retinopathy Classification Using Deep Learning Technique. Proceedings of the 2022 6th International Conference on Trends in Electronics and Informatics (ICOEI), Tirunelveli, India.10.1109/ICOEI53556.2022.9777100 ↗
8. Vipparthi, V., Rao, D.R., Mullu, S., and Patlolla, V. (2022, January 17–19). Diabetic Retinopathy Classification Using Deep Learning Techniques. Proceedings of the 2022 3rd International Conference on Electronics and Sustainable Communication Systems (ICESC), Coimbatore, India.10.1109/ICESC54411.2022.9885687 ↗
9. Thomas, N.M., and Jerome, S.A. (2022). Advances in Electrical and Computer Technologies, Springer.
10. A survey on transfer learning10.1109/TKDE.2009.191 ↗
11. A survey of transfer learning10.1186/s40537-016-0043-6 ↗
12. Deep learning based computer-aided diagnosis systems for diabetic retinopathy: A survey10.1016/j.artmed.2019.07.009 ↗
13. A Deep Learning Ensemble Approach for Diabetic Retinopathy Detection10.1109/ACCESS.2019.2947484 ↗
14. Sebastian, A., Elharrouss, O., Al-Maadeed, S., and Almaadeed, N. (2023). A Survey on Deep-Learning-Based Diabetic Retinopathy Classification. Diagnostics, 13.10.3390/diagnostics13030345 ↗
15. Jiwani, N., Gupta, K., Sharif, M.H.U., Datta, R., Habib, F., and Afreen, N. (2023, January 3–5). Application of Transfer Learning Approach for Diabetic Retinopathy Classification. Proceedings of the 2023 International Conference on Power Electronics and Energy (ICPEE), Bhubaneswar, India.10.1109/ICPEE54198.2023.10060777 ↗
16. Torrey, L., and Shavlik, J. (2010). Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques, IGI Global.10.4018/978-1-60566-766-9.ch011 ↗
17. Chilukoti, S.V., Shan, L., Maida, A.S., and Hei, X. (2023). A Reliable Diabetic Retinopathy Grading via Transfer Learning with Quadratic Weighted Kappa Metric. Res. Sq.10.21203/rs.3.rs-2383368/v1 ↗
18. Vij, R., and Arora, S. A novel deep transfer learning based computerized diagnostic Systems for Multi-class imbalanced diabetic retinopathy severity classification, Multimed. Tools Appl., in press.
19. Qomariah, D.U.N., Tjandrasa, H., and Fatichah, C. (2019, January 18). Classification of Diabetic Retinopathy and Normal Retinal Images Using CNN and SVM. Proceedings of the 2019 12th International Conference on Information & Communication Technology and System (ICTS), Surabaya, Indonesia.10.1109/ICTS.2019.8850940 ↗
20. Rahhal, D., Alhamouri, R., Albataineh, I., and Duwairi, R. (2022, January 21–23). Detection and Classification of Diabetic Retinopathy Using Artificial Intelligence Algorithms. Proceedings of the 2022 13th International Conference on Information and Communication Systems (ICICS), Irbid, Jordan.10.1109/ICICS55353.2022.9811197 ↗
21. Ioffe, S., and Szegedy, C. (2015, January 6–11). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Proceedings of the 32nd International Conference on Machine Learning, Lille, France.
22. Simonyan, K., and Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv, 2014.
23. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely Connected Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
24. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv.
25. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
26. Doshi, D., Shenoy, A., Sidhpura, D., and Gharpure, P. (2016, January 11). Diabetic Retinopathy Detection Using Deep Convolutional Neural Networks. Proceedings of the Computing, Analytics and Security Trends (CAST), International Conference on Computing, Analytics and Security Trends (CAST), Pune, India.10.1109/CAST.2016.7914977 ↗
27. Kothare, K.S., and Malpe, K. (2019, January 27–29). Design and Implementation of Inspection Model for knowledge Patterns Classification in Diabetic Retinal Images. Proceedings of the 2019 3rd International Conference on Computing Methodologies and Communication (ICCMC), Erode, India.10.1109/ICCMC.2019.8819647 ↗
28. Hussain, M.A., Islam, S.O.B., Tiwana, M., and Qureshi, W. (2019, January 19–22). Detection and Classification of Hard Exudates with Fundus Images Complements and Neural Networks. Proceedings of the 2019 5th International Conference on Control, Automation and Robotics (ICCAR), Beijing, China.10.1109/ICCAR.2019.8813469 ↗
29. Ahmad, M., Kasukurthi, N., and Pande, H. (2019, January 8–11). Deep Learning for Weak Supervision of Diabetic Retinopathy Abnormalities. Proceedings of the 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), Venice, Italy.10.1109/ISBI.2019.8759417 ↗
30. Diabetic Retinopathy Detection and Classification Using Mixed Models for a Disease Grading Database10.1109/ACCESS.2021.3056186 ↗
31. Diabetic retinopathy classification using VGG16 neural network10.1007/s42600-022-00200-8 ↗
32. Nadeem, M.W., Goh, H.G., Hussain, M., Liew, S.-Y., Andonovic, I., and Khan, M.A. (2022). Deep learning for diabetic retinopathy analysis: A review, research challenges, and future directions. Sensors, 22.10.3390/s22186780 ↗
33. Fayyaz, A.M., Sharif, M.I., Azam, S., Karim, A., and El-Den, J. (2023). Analysis of Diabetic Retinopathy (DR) Based on the Deep Learning. Information, 14.10.3390/info14010030 ↗
34. Diabetic Retinopathy Identification Using Parallel Convolutional Neural Network Based Feature Extractor and ELM Classifier10.1016/j.eswa.2023.119557 ↗
35. Jena, P.K., Khuntia, B., Palai, C., Nayak, M., Mishra, T.K., and Mohanty, S.N. (2023). A Novel Approach for Diabetic Retinopathy Screening Using Asymmetric Deep Learning Features. Big Data Cogn. Comput., 7.10.3390/bdcc7010025 ↗
36. The art of data augmentation10.1198/10618600152418584 ↗
37. A survey on image data augmentation for deep learning10.1186/s40537-019-0197-0 ↗
38. Mungloo-Dilmohamud, Z., Heenaye-Mamode Khan, M., Jhumka, K., Beedassy, B.N., Mungloo, N.Z., and Peña-Reyes, C. (2022). Balancing Data through Data Augmentation Improves the Generality of Transfer Learning for Diabetic Retinopathy Classification. Appl. Sci., 12.10.3390/app12115363 ↗
39. Rajamani, S., and Sasikala, S. (2023). Artificial Intelligence Approach for Diabetic Retinopathy Severity Detection. Informatica, 46.10.31449/inf.v46i8.4425 ↗
40. Mondal, S.S., Mandal, N., Singh, K.K., Singh, A., and Izonin, I. (2023). EDLDR: An Ensemble Deep Learning Technique for Detection and Classification of Diabetic Retinopathy. Diagnostics, 13.10.3390/diagnostics13010124 ↗
41. Classification of Diabetic Retinopathy Severity in Fundus Images Using the Vision Transformer and Residual Attention10.1155/2023/1305583 ↗
42. Diabetic retinopathy grading by a source-free transfer learning approach10.1016/j.bspc.2021.103423 ↗
43. Xu, S., Huang, Z., and Zhang, Y. (2022, November 21). Diabetic Retinopathy Progression Recognition Using Deep Learning Method. Available online: http://cs231n.stanford.edu/reports/2022/pdfs/20.pdf.
44. Classification of diabetic retinopathy based on improved deep forest model10.1016/j.bspc.2022.104020 ↗
45. Deep learning-based automated detection for diabetic retinopathy and diabetic macular oedema in retinal fundus photographs10.1038/s41433-021-01552-8 ↗
46. Jiwani, N., Gupta, K., and Afreen, N. (2022, January 23–24). A Convolutional Neural Network Approach for Diabetic Retinopathy Classification. Proceedings of the 2022 IEEE 11th International Conference on Communication Systems and Network Technologies (CSNT), Indore, India.10.1109/CSNT54456.2022.9787577 ↗
47. Bilal, A., Zhu, L., Deng, A., Lu, H., and Wu, N. (2022). AI-Based Automatic Detection and Classification of Diabetic Retinopathy Using U-Net and Deep Learning. Symmetry, 14.10.3390/sym14071427 ↗
48. A Transfer Learning and U-Net-based automatic detection of diabetic retinopathy from fundus images10.1080/21681163.2021.2021111 ↗
49. Saranya, P., Umamaheswari, K.M., Sivaram, M., Jain, C., and Bagchi, D. (2021, January 19–21). Classification of Different Stages of Diabetic Retinopathy Using Convolutional Neural Networks. Proceedings of the 2021 2nd International Conference on Computation, Automation and Knowledge Management (ICCAKM), Dubai, United Arab Emirates.10.1109/ICCAKM50778.2021.9357735 ↗
50. DiaNet: A Deep Learning Based Architecture to Diagnose Diabetes Using Retinal Images Only10.1109/ACCESS.2021.3052477 ↗
51. Deep Learning Approach for Stages of Severity Classification in Diabetic Retinopathy Using Color Fundus Retinal Images10.1155/2021/7627566 ↗
52. A transfer learning with deep neural network approach for diabetic retinopathy classification
53. Deep Transfer Learning Models for Medical Diabetic Retinopathy Detection10.5455/aim.2019.27.327-332 ↗
54. Hagos, M.T., and Kant, S. (2019). Transfer learning based detection of diabetic retinopathy from small dataset. arXiv.
55. (2022, September 05). APTOS 2019 Blindness Detection. Available online: https://www.kaggle.com/competitions/aptos2019-blindness-detection/overview.
56. EyePACS: An adaptable telemedicine system for diabetic retinopathy screening10.1177/193229680900300315 ↗
57. (2022, September 05). Ocular Disease Intelligent Recognition ODIR-5K. Available online: https://odir2019.grand-challenge.org/.
58. (2022, September 05). Diabetic Retinopathy Detection. Available online: https://www.kaggle.com/c/diabetic-retinopathy-detection.
59. The class imbalance problem: A systematic study10.3233/IDA-2002-6504 ↗
60. What makes multi-class imbalanced problems difficult? An experimental study10.1016/j.eswa.2022.116962 ↗
61. A survey on recent developments in diabetic retinopathy detection through integration of deep learning10.1007/s11042-022-13837-5 ↗
62. Automated diabetic retinopathy detection based on binocular siamese-like convolutional neural network10.1109/ACCESS.2019.2903171 ↗
63. Diagnosis of diabetic retinopathy using deep neural networks10.1109/ACCESS.2018.2888639 ↗
64. Costa, P., Araújo, T., Aresta, G., Galdran, A., Mendonça, A.M., Smailagic, A., and Campilho, A. (2019, January 27–31). EyeWes: Weakly Supervised Pre-Trained Convolutional Neural Networks for Diabetic Retinopathy Detection. Proceedings of the 2019 16th International Conference on Machine Vision Applications (MVA), Tokyo, Japan.10.23919/MVA.2019.8757991 ↗
65. Elsharkawy, M., Elrazzaz, M., Sharafeldeen, A., Alhalabi, M., Khalifa, F., Soliman, A., Elnakib, A., Mahmoud, A., Ghazal, M., and El-Daydamony, E. (2022). The Role of Different Retinal Imaging Modalities in Predicting Progression of Diabetic Retinopathy: A Survey. Sensors, 22.10.3390/s22093490 ↗
66. Automatic Diabetic Retinopathy Diagnosis Using Adaptive Fine-Tuned Convolutional Neural Network10.1109/ACCESS.2021.3065273 ↗
67. Kandel, I., and Castelli, M. (2020). Transfer learning with convolutional neural networks for diabetic retinopathy image classification. A review. Appl. Sci., 10.10.3390/app10062021 ↗
68. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.-C. (2018, January 18–23). Mobilenetv2: Inverted Residuals and Linear Bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
69. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27–30). Rethinking the Inception Architecture for Computer Vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.308 ↗
70. Magician’s corner: 9. Performance metrics for machine learning models10.1148/ryai.2021200126 ↗
71. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2016). Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv.
72. Scikit-learn: Machine learning in Python
73. Medical image analysis using convolutional neural networks: A review10.1007/s10916-018-1088-1 ↗
74. Bagadi, L., Pavankumar, E., Likitha, A., Niranjan, K., and Nani, B. (2022). Innovations in Electronics and Communication Engineering, Springer.
75. Sarki, R., Michalska, S., Ahmed, K., Wang, H., and Zhang, Y. (2019). Convolutional neural networks for mild diabetic retinopathy detection: An experimental study. bioRxiv.10.1101/763136 ↗
76. Sheikh, S.O. (2022, December 19). Diabetic Reinopathy Classification Using Deep Learning. Available online: https://qspace.qu.edu.qa/bitstream/handle/10576/15230/Sarah%20Obaid%20Sheikh%20_OGS%20Approved%20Thesis.pdf?sequence=1&isAllowed=y.
77. Understanding receiver operating characteristic (ROC) curves10.1017/S1481803500013336 ↗
78. A Novel Attention Based Few-shot Classification Framework for Diabetic Retinopathy Detection and Grading10.1016/j.measurement.2022.111485 ↗
79. Jabbar, M.K., Yan, J., Xu, H., Ur Rehman, Z., and Jabbar, A. (2022). Transfer Learning-Based Model for Diabetic Retinopathy Diagnosis Using Retinal Images. Brain Sci., 12.10.3390/brainsci12050535 ↗
80. Khaled, O., El-Sahhar, M., El-Dine, M.A., Talaat, Y., Hassan, Y.M.I., and Hamdy, A. (2021, January 11–13). Cascaded Architecture for Classifying the Preliminary Stages of Diabetic Retinopathy. Proceedings of the 9th International Conference on Software and Information Engineering, Cairo, Egypt.10.1145/3436829.3436854 ↗
81. Transfer Learning for Automated OCTA Detection of Diabetic Retinopathy10.1167/tvst.9.2.35 ↗
82. Deep convolutional neural networks for diabetic retinopathy detection by image classification10.1016/j.compeleceng.2018.07.042 ↗