journal article·2020-09-05Open access

Retinal Image Analysis for Diabetes-Based Eye Disease Detection Using Deep Learning

Tahira Nazir, Aun Irtaza, Ali Javed, Hafiz Malik, Dildar Hussain, Rizwan Ali Naqvi

Applied Sciences· Volume 10· Issue 18

Abstract

Diabetic patients are at the risk of developing different eye diseases i.e., diabetic retinopathy (DR), diabetic macular edema (DME) and glaucoma. DR is an eye disease that harms the retina and DME is developed by the accumulation of fluid in the macula, while glaucoma damages the optic disk and causes vision loss in advanced stages. However, due to slow progression, the disease shows few signs in early stages, hence making disease detection a difficult task. Therefore, a fully automated system is required to support the detection and screening process at early stages. In this paper, an automated disease localization and segmentation approach based on Fast Region-based Convolutional Neural Network (FRCNN) algorithm with fuzzy k-means (FKM) clustering is presented. The FRCNN is an object detection approach that requires the bounding-box annotations to work; however, datasets do not provide them, therefore, we have generated these annotations through ground-truths. Afterward, FRCNN is trained over the annotated images for localization that are then segmented-out through FKM clustering. The segmented regions are then compared against the ground-truths through intersection-over-union operations. For performance evaluation, we used the Diaretdb1, MESSIDOR, ORIGA, DR-HAGIS, and HRF datasets. A rigorous comparison against the latest methods confirms the efficacy of the approach in terms of both disease detection and segmentation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Retinal Imaging and Analysis · Retinal Diseases and Treatments · Glaucoma and retinal disorders

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science, University of Engineering and Technology, Taxila 47050, Pakistan

Department of Software Engineering, University of Engineering and Technology, Taxila 47050, Pakistan

Department of Electrical and Computer Engineering, University of Michigan-Dearborn, MI 48128, USA

School of Computational Sciences, Korea Institute for Advanced Study (KIAS), 85 Hoegiro Dongdaemun-gu, Soeul 02455, Korea

Department of Unmanned Vehicle Engineering, Sejong University, 209, Neundong-ro, Gwangjin-gu, Seoul 05006, Korea

Funding

KIAS and Sejong University Faculty Research Fund.

References (74)

Show source-provided references
1. Automatic Detection of Diabetic Retinopathy: A Review on Datasets, Methods and Evaluation Metrics10.1109/ACCESS.2020.2980055 ↗
2. Rekhi, R.S., Issac, A., and Dutta, M.K. (2017, January 26–28). Automated detection and grading of diabetic macular edema from digital colour fundus images. Proceedings of the 2017 4th IEEE Uttar Pradesh Section International Conference on Electrical, Computer and Electronics (UPCON), Mathura, India.10.1109/UPCON.2017.8251096 ↗
3. Al-Bander, B., Al-Nuaimy, W., Al-Taee, M.A., and Zheng, Y. (2017, January 28–31). Automated glaucoma diagnosis using deep learning approach. Proceedings of the 2017 14th International Multi-Conference on Systems, Signals & Devices (SSD), Marrakech, Morocco.10.1109/SSD.2017.8166974 ↗
4. Diabetic retinopathy detection using red lesion localization and convolutional neural networks10.1016/j.compbiomed.2019.103537 ↗
5. Kunwar, A., Magotra, S., and Sarathi, M.P. (2015, January 10–13). Detection of high-risk macular edema using texture features and classification using SVM classifier. Proceedings of the 2015 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Kochi, India.10.1109/ICACCI.2015.7275958 ↗
6. The number of people with glaucoma worldwide in 2010 and 202010.1136/bjo.2005.081224 ↗
7. Magnitude, temporal trends, and projections of the global prevalence of blindness and distance and near vision impairment: A systematic review and meta-analysis10.1016/S2214-109X(17)30293-0 ↗
8. Al-Bander, B., Williams, B.M., Al-Nuaimy, W., Al-Taee, M.A., Pratt, H., and Zheng, Y. (2018). Dense Fully Convolutional Segmentation of the Optic Disc and Cup in Colour Fundus for Glaucoma Diagnosis. Symmetry, 10.10.3390/sym10040087 ↗
9. Chen, X., Xu, Y., Wong, D.W.K., Wong, T.Y., and Liu, J. (2015, January 25–29). Glaucoma detection based on deep convolutional neural network. Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy.10.1109/EMBC.2015.7318462 ↗
10. Retinal Fundus Image Analysis for Diagnosis of Glaucoma: A Comprehensive Survey10.1109/ACCESS.2016.2596761 ↗
11. Sinthanayothin, C. (1999). Image Analysis for Automatic Diagnosis of Diabetic Retinopathy, University of London.
12. Unsupervised Automated Retinal Vessel Extraction Framework Using Enhanced Filtering and Hessian Based Method with Hysteresis Thresholding10.1166/jmihi.2019.2687 ↗
13. Detection of Subclinical Diabetic Retinopathy by Fine Structure Analysis of Retinal Images10.1155/2019/5171965 ↗
14. A Deep Learning Ensemble Approach for Diabetic Retinopathy Detection10.1109/ACCESS.2019.2947484 ↗
15. Multi-label classification of retinal lesions in diabetic retinopathy for automatic analysis of fundus fluorescein angiography based on deep learning. Graefe’s Arch
16. Automated detection and classification of fundus diabetic retinopathy images using synergic deep learning model10.1016/j.patrec.2020.02.026 ↗
17. Riaz, H., Park, J., Choi, H., Kim, H., and Kim, J. (2020). Deep and Densely Connected Networks for Classification of Diabetic Retinopathy. Diagnostics, 10.10.3390/diagnostics10010024 ↗
18. A Multiscale Optimization Approach to Detect Exudates in the Macula10.1109/JBHI.2013.2296399 ↗
19. Rekhi, R.S., Issac, A., Dutta, M.K., and Travieso, C.M. (2017, January 10–12). Automated classification of exudates from digital fundus images. Proceedings of the 2017 International Conference and Workshop on Bioinspired Intelligence (IWOBI), Funchal, Portugal.10.1109/IWOBI.2017.7985527 ↗
20. Automated Glaucoma Detection from Fundus Images of Eye Using Statistical Feature Extraction Methods and Support Vector Machine Classification
21. Automated glaucoma detection using hybrid feature extraction in retinal fundus images10.1142/S0219519413500115 ↗
22. A new approach of cup to disk ratio based glaucoma detection using fundus images10.3233/jid-2016-0004 ↗
23. Automated diagnosis of glaucoma using digital fundus images10.1007/s10916-008-9195-z ↗
24. Salam, A.A., Akram, M.U., Wazir, K., Anwar, S.M., and Majid, M. (2015, January 7–10). Autonomous Glaucoma detection from fundus image using cup to disc ratio and hybrid features. Proceedings of the 2015 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), Abu Dhabi, UAE.10.1109/ISSPIT.2015.7394362 ↗
25. Automated glaucoma detection using quasi-bivariate variational mode decomposition from fundus images10.1049/iet-ipr.2019.0036 ↗
26. Computed-aided diagnosis (CAD) in the detection of breast cancer10.1016/j.ejrad.2012.03.005 ↗
27. Improved Automated Detection of Diabetic Retinopathy on a Publicly Available Dataset Through Integration of Deep Learning10.1167/iovs.16-19964 ↗
28. Automated Diabetic Retinopathy Detection Based on Binocular Siamese-Like Convolutional Neural Network10.1109/ACCESS.2019.2903171 ↗
29. Diabetic macular edema grading in retinal images using vector quantization and semi-supervised learning10.3233/THC-174704 ↗
30. An exudate detection method for diagnosis risk of diabetic macular edema in retinal images using feature-based and supervised classification
31. Perdomo, O., Otalora, S., Rodríguez, F., Arevalo, J., González, F.A., Chen, X., Garvin, M.K., Liu, J., Trucco, E., and Xu, Y. (2016, January 21). A Novel Machine Learning Model Based on Exudate Localization to Detect Diabetic Macular Edema. Proceedings of the Ophthalmic Medical Image Analysis Third International Workshop, Athens, Greece.10.17077/omia.1057 ↗
32. JointRCNN: A Region-Based Convolutional Neural Network for Optic Disc and Cup Segmentation10.1109/TBME.2019.2913211 ↗
33. Shankaranarayana, S.M., Ram, K., Mitra, K., and Sivaprakasam, M. (2017). Joint optic disc and cup segmentation using fully convolutional and adversarial networks. Fetal, Infant and Ophthalmic Medical Image Analysis, Springer.10.1007/978-3-319-67561-9_19 ↗
34. Deep convolution neural network for accurate diagnosis of glaucoma using digital fundus images10.1016/j.ins.2018.01.051 ↗
35. Optic disc and cup segmentation methods for glaucoma detection with modification of U-Net convolutional neural network10.1134/S1054661817030269 ↗
36. Glaucoma-Deep: Detection of Glaucoma Eye Disease on Retinal Fundus Images using Deep Learning
37. Bajwa, M.N., Malik, M.I., Siddiqui, S.A., Dengel, A., Shafait, F., Neumeier, W., and Sheraz Ahmed, S. (2019). Two-stage framework for optic disc localization and glaucoma classification in retinal fundus images using deep learning. BMC Med. Inf. Decis. Mak., 19.10.1186/s12911-019-0842-8 ↗
38. Lu, Z., and Chen, D. (2020). Weakly Supervised and Semi-Supervised Semantic Segmentation for Optic Disc of Fundus Image. Symmetry, 12.10.3390/sym12010145 ↗
39. Improved image processing techniques for optic disc segmentation in retinal fundus images10.1016/j.bspc.2019.101832 ↗
40. Automated identification and grading system of diabetic retinopathy using deep neural networks10.1016/j.knosys.2019.03.016 ↗
41. A deep learning interpretable classifier for diabetic retinopathy disease grading10.1016/j.neucom.2018.07.102 ↗
42. Tzutalin (2020, January 11). LabelImg. Available online: https://github.com/tzutalin/labelImg.
43. Wang, X., Shrivastava, A., and Gupta, A. (2017, January 21–26). A-Fast-RCNN: Hard Positive Generation via Adversary for Object Detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.324 ↗
44. Spatial pyramid pooling in deep convolutional networks for visual recognition10.1109/TPAMI.2015.2389824 ↗
45. Girshick, R., Donahue, J., Darrell, T., Malik, J., and Malik, J. (2014, January 24–27). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
46. Denton, E.L., Zaremba, W., Bruna, J., LeCun, Y., and Fergus, R. (2014). Exploiting linear structure within convolutional networks for efficient evaluation. Advances in Neural Information Processing Systems, MIT Press.
47. Girshick, R. (2015, January 11–18). Fast R-CNN. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Las Condes, Chile.10.1109/ICCV.2015.169 ↗
48. Qin, Z., and Kim, D. (2020, January 25). Rethinking Softmax with Cross-Entropy: Neural Network Classifier as Mutual Information Estimator. Available online: https://arxiv.org/abs/1911.10688.
49. Advantages of fuzzy k-means over k-means clustering in the classification of diffuse reflectance soil spectra: A case study with West African soils10.1016/j.geoderma.2018.09.004 ↗
50. Topic Modeling Technique for Text Mining Over Biomedical Text Corpora through Hybrid Inverse Documents Frequency and Fuzzy K-Means Clustering10.1109/ACCESS.2019.2944973 ↗
51. The DIARETDB1 diabetic retinopathy database and evaluation protocol
52. Retinal vessel segmentation by improved matched filtering: Evaluation on a new high-resolution fundus image database10.1049/iet-ipr.2012.0455 ↗
53. DR HAGIS—A fundus image database for the automatic extraction of retinal surface vessels from diabetic patients10.1117/1.JMI.4.1.014503 ↗
54. Zhang, Z.Z., Yin, F.S., Liu, J.J., Wong, W.K., Tan, N.M., Lee, B.H., Cheng, J., and Wong, T.Y. (September, January 31). ORIGA-light: An online retinal fundus image database for glaucoma analysis and research. Proceedings of the 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, Buenos Aires, Argentina.
55. Urdu-Text Detection and Recognition in Natural Scene Images Using Deep Learning10.1109/ACCESS.2020.2994214 ↗
56. Region-Based Convolutional Networks for Accurate Object Detection and Segmentation10.1109/TPAMI.2015.2437384 ↗
57. Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs10.1001/jama.2016.17216 ↗
58. Deep multiple instance learning for automatic detection of diabetic retinopathy in retinal images10.1049/iet-ipr.2017.0636 ↗
59. A generalized method for the segmentation of exudates from pathological retinal fundus images10.1016/j.bbe.2017.10.003 ↗
60. Automatic recognition of severity level for diagnosis of diabetic retinopathy using deep visual features
61. Granero, A.C., Igual, J., and Naranjo, V. (2020). Detection of Early Signs of Diabetic Retinopathy Based on Textural and Morphological Information in Fundus Images. Sensors, 20.10.3390/s20041005 ↗
62. CANet: Cross-Disease Attention Network for Joint Diabetic Retinopathy and Diabetic Macular Edema Grading10.1109/TMI.2019.2951844 ↗
63. Detection and discrimination of disease-related abnormalities based on learning normal cases10.1016/j.patcog.2012.03.020 ↗
64. An effective fovea detection and automatic assessment of diabetic maculopathy in color fundus images10.1016/j.compbiomed.2016.04.007 ↗
65. Lim, S., Zaki, W.M.D.W., Hussain, A., Kusalavan, S., and Lim, S.L. (2011, January 5–6). Automatic classification of diabetic macular edema in digital fundus images. Proceedings of the 2011 IEEE Colloquium on Humanities, Science and Engineering, Penang, Malaysia.10.1109/CHUSER.2011.6163730 ↗
66. Rahim, S., Palade, V., Jayne, C., Holzinger, A., and Shuttleworth, J. (2015). Detection of diabetic retinopathy and maculopathy in eye fundus images using fuzzy image processing. International Conference on Brain Informatics and Health, Springer.10.1007/978-3-319-23344-4_37 ↗
67. Fundus Images-Based Detection and Grading of Macular Edema Using Robust Macula Localization10.1109/ACCESS.2018.2873415 ↗
68. Predicting optical coherence tomography-derived diabetic macular edema grades from fundus photographs using deep learning10.1038/s41467-019-13922-8 ↗
69. DME-Net: Diabetic Macular Edema Grading by Auxiliary Task Learning10.1007/978-3-030-32239-7_87 ↗
70. Clinical Interpretable Deep Learning Model for Glaucoma Diagnosis10.1109/JBHI.2019.2949075 ↗
71. Chen, X., Xu, Y., Yan, S., Wong, D.W.K., Wong, T.Y., and Liu, J. Automatic Feature Learning for Glaucoma Detection Based on Deep Learning. Proceedings of the Bioinformatics Research and Applications.
72. Xu, Y., Lin, S., Wong, D.W.K., Liu, J., and Xu, D. (2013). Efficient Reconstruction-Based Optic Cup Localization for Glaucoma Screening. Proceedings of the Computer Vision, Springer Science and Business Media LLC.10.1007/978-3-642-40760-4_56 ↗
73. Li, A., Cheng, J., Wong, D.W.K., and Liu, J. (2016, January 16–20). Integrating holistic and local deep features for glaucoma classification. Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA.10.1109/EMBC.2016.7590952 ↗
74. An Efficient Detection System for Screening Glaucoma InRetinal Images10.13005/bpj/1130 ↗