A Comprehensive Approach for an Interpretable Diabetic Macular Edema Grading System Based on ConvUNext
Source abstract
Abstract
Diabetic macular edema (DME) is a leading cause of vision impairment in diabetic patients, necessitating a timely and accurate diagnosis. This paper proposes a comprehensive system for DME grading using retinal fundus images. Our approach integrates multiple deep learning modules, each designed to address key aspects of the diagnostic process. The first module employs the ConvUNeXt model for segmenting hard exudates (HaEx), crucial indicators of DME. The second module uses RetinaNet for precise optic disc (OD) localization, which is essential for subsequent macula localization. The third module refines macula localization, leveraging preprocessing techniques to enhance image clarity. Finally, our system consolidates these results to provide interpretable DME grading. Experimental evaluations were conducted on the Messidor dataset, demonstrating the system’s robust performance. The HaEx segmentation module achieved a mean IoU of 70.5% and a Dice coefficient of 0.64. The OD localization module showed perfect accuracy, recall, and precision at 1.0. For macula localization, our method satisfied the 1R criterion with 99.38% accuracy. The DME grading module achieved an overall accuracy of 91.12%, with an AUC of 0.9334. Our method offers a balanced performance across accuracy, sensitivity, and specificity compared to other non-interpretable and partially interpretable methods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Retinal Imaging and Analysis · Retinal Diseases and Treatments · Glaucoma and retinal disorders
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Graduate Section, Mechanical Electronic Engineering School, Instituto Politecnico Nacional, Av. Santa Ana 1000, Mexico City 04440, Mexico
Mechatronics Department, Cuernavaca Campus, Tecnologico de Monterrey 2, Cuernavaca 62790, Morelos, Mexico
Funding
The Instituto Politecnico Nacional of Mexico
References (44)
Show source-provided references
1. Shaban, M., Ogur, Z., Mahmoud, A., Switala, A., Shalaby, A., Khalifeh, H.A., Ghazal, M., Fraiwan, L., Giridharan, G., and Sandhu, H. (2020). A Convolutional Neural Network for the Screening and Staging of Diabetic Retinopathy. PLoS ONE, 15.10.1371/journal.pone.0233514 ↗
2. A Comprehensive Review on Automated Systems for Severity Grading of Diabetic Retinopathy and Macular Edema10.1002/ima.22574 ↗
3. Yasashvini, R., Vergin Raja Sarobin, M., Panjanathan, R., Graceline Jasmine, S., and Jani Anbarasi, L. (2022). Diabetic Retinopathy Classification Using CNN and Hybrid Deep Convolutional Neural Networks. Symmetry, 14.10.3390/sym14091932 ↗
4. Computer-Aided Diagnosis of Diabetic Retinopathy: A Review10.1016/j.compbiomed.2013.10.007 ↗
5. Automatic Grading of Diabetic Macular Edema Based on End-to-End Network10.1016/j.eswa.2022.118835 ↗
6. An Ensemble-Based System for Automatic Screening of Diabetic Retinopathy10.1016/j.knosys.2013.12.023 ↗
7. Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs10.1001/jama.2016.17216 ↗
8. Sreejini, K.S., and Govindan, V.K. (2013, January 29–31). Automatic Grading of Severity of Diabetic Macular Edema Using Color Fundus Images. Proceedings of the 2013 3rd International Conference on Advances in Computing and Communications, ICACC 2013, Cochin, India.10.1109/ICACC.2013.42 ↗
9. Kunwar, A., Magotra, S., and Sarathi, M.P. (2015, January 10–13). Detection of High-Risk Macular Edema Using Texture Features and Classification Using SVM Classifier. Proceedings of the 2015 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2015, Kochi, India.10.1109/ICACCI.2015.7275958 ↗
10. Zubair, M., Ahmad, J., Alqahtani, F., Khan, F., Shah, S.A., Abbasi, Q.H., and Jan, S.U. (2022, January 9–11). Automated Grading of Diabetic Macular Edema Using Color Retinal Photographs. Proceedings of the 2022 2nd International Conference of Smart Systems and Emerging Technologies, SMARTTECH 2022, Riyadh, Saudi Arabia.10.1109/SMARTTECH54121.2022.00016 ↗
11. Diabetic Macular Edema Grading in Retinal Images Using Vector Quantization and Semi-Supervised Learning10.3233/THC-174704 ↗
12. Al-Bander, B., Al-Nuaimy, W., Al-Taee, M.A., Williams, B.M., and Zheng, Y. (2017). Diabetic Macular Edema Grading Based on Deep Neural Networks, The University of Iowa.10.17077/omia.1055 ↗
13. Sahlsten, J., Jaskari, J., Kivinen, J., Turunen, L., Jaanio, E., Hietala, K., and Kaski, K. (2019). Deep Learning Fundus Image Analysis for Diabetic Retinopathy and Macular Edema Grading. Sci. Rep., 9.10.1038/s41598-019-47181-w ↗
14. He, X., Zhou, Y., Wang, B., Cui, S., and Shao, L. (2019, January 13–17). DME-Net: Diabetic Macular Edema Grading by Auxiliary Task Learning. Proceedings of the Medical Image Computing and Computer Assisted Intervention (MICCAI), Shenzhen, China.10.1007/978-3-030-32239-7_87 ↗
15. Wang, Z., Zhong, Y., Yao, M., Ma, Y., Zhang, W., Li, C., Tao, Z., Jiang, Q., and Yan, B. (2021). Automated Segmentation of Macular Edema for the Diagnosis of Ocular Disease Using Deep Learning Method. Sci. Rep., 11.10.1038/s41598-021-92458-8 ↗
16. Diabetic Macular Edema Grading Based on Improved Faster R-CNN and MD-ResNet10.1007/s11760-020-01792-3 ↗
17. Wang, T.Y., Chen, Y.H., Chen, J.T., Liu, J.T., Wu, P.Y., Chang, S.Y., Lee, Y.W., Su, K.C., and Chen, C.L. (2022). Diabetic Macular Edema Detection Using End-to-End Deep Fusion Model and Anatomical Landmark Visualization on an Edge Computing Device. Front. Med., 9.10.3389/fmed.2022.851644 ↗
18. Singh, R.K., and Gorantla, R. (2020). DMenet: Diabetic Macular Edema Diagnosis Using Hierarchical Ensemble of CNNs. PLoS ONE, 15.10.1371/journal.pone.0220677 ↗
19. Deep Learning-Based Automated Detection for Diabetic Retinopathy and Diabetic Macular Oedema in Retinal Fundus Photographs10.1038/s41433-021-01552-8 ↗
20. Yao, Z., Yuan, Y., Shi, Z., Mao, W., Zhu, G., Zhang, G., and Wang, Z. (2022). FunSwin: A Deep Learning Method to Analysis Diabetic Retinopathy Grade and Macular Edema Risk Based on Fundus Images. Front. Physiol., 13.10.3389/fphys.2022.961386 ↗
21. Causability and Explainability of Artificial Intelligence in Medicine10.1002/widm.1312 ↗
22. Evaluation of Explainable Deep Learning Methods for Ophthalmic Diagnosis10.2147/OPTH.S312236 ↗
23. Yeonwoo, J., Yu-Jin, H., and Jae-Ho, H. (2022). Review of Machine Learning Applications using Retinal Fundus Images. Diagnostics, 12.10.3390/diagnostics12010134 ↗
24. Sebastian, A., Elharrouss, O., Al-Maadeed, S., and Al-Maadeed, N. (2023). A survey on Deep-Learning-Based Diabetic Retinopathy Classification. Diagnostics, 13.10.3390/diagnostics13030345 ↗
25. Machine Learning and Deep Learning Techniques for Optic Disc and Cup Segmentation—A Review10.2147/OPTH.S348479 ↗
26. Jihyoung, R., Mobeen, R., Imran, N., and Kil, C. (2023). SegR-Net: A Deep Learning Framework with Multi-Scale Feature Fusion for Robust Retinal Vessel Segmentation. Comput. Biol. Med., 163.10.1016/j.compbiomed.2023.107132 ↗
27. Wan, C., Zhou, X., You, Q., Sun, J., Shen, J., Zhu, S., Jiang, Q., and Yang, W. (2022). Retinal Image Enhancement using Cycle-Constraint Adversarial Network. Front. Med., 8.10.3389/fmed.2021.793726 ↗
28. Feedback on a Publicly Distributed Image Database: The Messidor Database10.5566/ias.1155 ↗
29. Wei, Q., Li, X., Yu, W., Zhang, X., Zhang, Y., Hu, B., Mo, B., Gong, D., Chen, N., and Ding, D. (2021, January 10–15). Learn to Segment Retinal Lesions and Beyond. Proceedings of the 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.10.1109/ICPR48806.2021.9412088 ↗
30. Diagnostic Assessment of Deep Learning Algorithms for Diabetic Retinopathy Screening10.1016/j.ins.2019.06.011 ↗
31. Novel Insights into the Mechanisms of Hard Exudate in Diabetic Retinopathy: Findings of Serum Lipidomic and Metabolomics Profiling10.1016/j.heliyon.2023.e15123 ↗
32. Convunext: An Efficient Convolution Neural Network for Medical Image Segmentation10.1016/j.knosys.2022.109512 ↗
33. Yutong, X., Bing, Y., Qingbiao, G., Jianpeng, Z., Qi, W., and Yong, X. (2023). Attention Mechanisms in Medical Image Segmentation: A Survey. arXiv.
34. Khojasteh, P., Aliahmad, B., and Kumar, D. (2018). Fundus Images Analysis Using Deep Features for Detection of Exudates, Hemorrhages and Microaneurysms. BMC Ophthalmol., 18.10.1186/s12886-018-0954-4 ↗
35. Ridge-based Vessel Segmentation in Color Images of the Retina10.1109/TMI.2004.825627 ↗
36. Focal Loss for Dense Object Detection10.1109/TPAMI.2018.2858826 ↗
37. Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014). Microsoft COCO: Common Objects in Context. Computer Vision—ECCV, Springer.10.1007/978-3-319-10602-1_48 ↗
38. Robust Detection and Classification of Longitudinal Changes in Color Retinal Fundus Images for Monitoring Diabetic Retinopathy10.1109/TBME.2005.863971 ↗
39. Calderon-Auza, G., Carrillo-Gomez, C., Nakano, M., Toscano-Medina, K., Perez-Meana, H., Leon, A.G.-H., and Quiroz-Mercado, H. (2020). A Teleophthalmology Support System Based on the Visibility of Retinal Elements Using the Cnns. Sensors, 20.10.3390/s20102838 ↗
40. Optic Disc Detection and Boundary Extraction in Retinal Images10.1364/AO.54.003440 ↗
41. Optic Disc Localization in Retinal Fundus Images Based on You Only Look Once Network (YOLO)
42. Locating the Fovea Center Position in Digital Fundus Images Using Thresholding and Feature Extraction Techniques10.1016/j.compmedimag.2013.06.002 ↗
43. Establishing the Macular Grading Grid by Means of Fovea Centre Detection Using Anatomical-based and Visual-based Features10.1016/j.compbiomed.2014.10.007 ↗
44. Fast Detection of the Main Anatomical Structures in Digital Retinal Images Based on Intra- and Inter-structure Relational Knowledge10.1016/j.cmpb.2017.06.022 ↗