Diabetic Retinopathy Diagnosis Based on RA-EfficientNet
Source abstract
Abstract
The early detection and grade diagnosis of diabetic retinopathy (DR) are very important for the avoidance of blindness, and using deep learning methods to automatically diagnose DR has attracted great attention. However, the small amount of DR data limits its application. To automatically learn the disease’s features and detect DR more accurately, we constructed a DR grade diagnostic model. To realize the model, the authors performed the following steps: firstly, we preprocess the DR images to solve the existing problems in an APTOS 2019 dataset, such as size difference, information redundancy and the data imbalance. Secondly, to extract more valid image features, a new network named RA-EfficientNet is proposed, in which a residual attention (RA) block is added to EfficientNet to extract more features and to solve the problem of small differences between lesions. EfficientNet has been previously trained on the ImageNet dataset, based on transfer learning technology, to overcome the small sample size problem of DR. Lastly, based on the extracted features, two classifiers are designed, one is a 2-grade classifier and the other a 5-grade classifier. The 2-grade classifier can diagnose DR, and the 5-grade classifier provides 5 grades of diagnosis for DR, as follows: 0 for No DR, 1 for mild DR, 2 for moderate, 3 for severe and 4 for proliferative DR. Experiments show that our proposed RA-EfficientNet can achieve better performance, with an accuracy value of 98.36% and a kappa score of 96.72% in a 2-grade classification and an accuracy value of 93.55% and a kappa score of 91.93% in a 5-grade classification. The results indicate that the proposed model effectively improves DR detection efficiency and resolves the existing limitation of manual feature extraction.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Retinal Imaging and Analysis · Retinal Diseases and Treatments · Digital Imaging for Blood Diseases
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, China
References (25)
Show source-provided references
1. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
2. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
3. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
4. Tan, M., and Le, Q. (2019, January 9–15). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning, PMLR, Long Beach, CA, USA.
5. Hierarchical retinal blood vessel segmentation based on feature and ensemble learning10.1016/j.neucom.2014.07.059 ↗
6. Deep convolution neural network for accurate diagnosis of glaucoma using digital fundus images10.1016/j.ins.2018.01.051 ↗
7. Hashimoto, N., Fukushima, D., Koga, R., Takagi, Y., Ko, K., Kohno, K., Nakaguro, M., Nakamura, S., Hontani, H., and Takeuchi, I. (2020, January 13–19). Multi-scale Domain-adversarial Multiple-instance CNN for Cancer Subtype Classification with Unannotated Histopathological Images. Proceedings of the IEEE/CVF Conference on Computer Vision and Patter Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00391 ↗
8. A survey on transfer learning10.1109/TKDE.2009.191 ↗
9. Automated identification of diabetic retinopathy using deep learning10.1016/j.ophtha.2017.02.008 ↗
10. Chetoui, M., and Akhloufi, M.A. (2020, January 20–24). Explainable Diabetic Retinopathy using EfficientNET. Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Montréal, QC, Canada.10.1109/EMBC44109.2020.9175664 ↗
11. Rao, M., Zhu, M., and Wang, T. (2020). Conversion and Implementation of State-of-the-Art Deep Learning Algorithms for the Classification of Diabetic Retinopathy. arXiv.
12. Modified Alexnet architecture for classification of diabetic retinopathy images10.1016/j.compeleceng.2019.03.004 ↗
13. Deep Convolution Features in Non-linear Embedding Space for Fundus Image Classification
14. Composite deep neural network with gated-attention mechanism for diabetic retinopathy severity classification10.1007/s12652-020-02727-z ↗
15. Majumder, S., and Kehtarnavaz, N. (2021). Multitasking Deep Learning Model for Detection of Five Stages of Diabetic Retinopathy. arXiv.10.1117/12.2557554 ↗
16. Patel, R., and Chaware, A. (2020, January 5–7). Transfer Learning with Fine-Tuned MobileNetV2 for Diabetic Retinopathy. Proceedings of the 2020 International Conference for Emerging Technology (INCET), Belgaum, India.10.1109/INCET49848.2020.9154014 ↗
17. (2021, May 21). Available online: https://www.kaggle.com/c/aptos2019-blindness-detection/data.
18. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
19. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18–23). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
20. Cao, Y., Xu, J., Lin, S., Wei, F., and Hu, H. (2019, January 27–28). Gcnet: Non-local networks meet squeeze-excitation networks and beyond. Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, Seoul, Korea.10.1109/ICCVW.2019.00246 ↗
21. Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A.A. (2017, January 4–9). Inception-v4, inception-resnet and the impact of residual connections on learning. Proceedings of the Thirty-first AAAI conference on artificial intelligence, San Francisco, CA, USA.10.1609/aaai.v31i1.11231 ↗
22. Chollet, F. (2017, January 21–26). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
23. (2021, April 15). Available online: https://www.kaggle.com/c/diabetic-retinopathy-detection.
24. Harihanth, K., and Karthikeyan, B. (2020, January 3–5). Diabetic Retinopathy Detection using ensemble deep Learning and Individual Channel Training. Proceedings of the 2020 3rd International Conference on Intelligent Sustainable Systems (ICISS), Coimbatore, India.
25. CABNet: Category attention block for imbalanced diabetic retinopathy grading10.1109/TMI.2020.3023463 ↗