journal article·2020-03-16Open access

Transfer Learning with Convolutional Neural Networks for Diabetic Retinopathy Image Classification. A Review

Ibrahem Kandel, Mauro Castelli

Applied Sciences· Volume 10· Issue 6

Abstract

Diabetic retinopathy (DR) is a dangerous eye condition that affects diabetic patients. Without early detection, it can affect the retina and may eventually cause permanent blindness. The early diagnosis of DR is crucial for its treatment. However, the diagnosis of DR is a very difficult process that requires an experienced ophthalmologist. A breakthrough in the field of artificial intelligence called deep learning can help in giving the ophthalmologist a second opinion regarding the classification of the DR by using an autonomous classifier. To accurately train a deep learning model to classify DR, an enormous number of images is required, and this is an important limitation in the DR domain. Transfer learning is a technique that can help in overcoming the scarcity of images. The main idea that is exploited by transfer learning is that a deep learning architecture, previously trained on non-medical images, can be fine-tuned to suit the DR dataset. This paper reviews research papers that focus on DR classification by using transfer learning to present the best existing methods to address this problem. This review can help future researchers to find out existing transfer learning methods to address the DR classification task and to show their differences in terms of performance.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Retinal Imaging and Analysis · Retinal Diseases and Treatments · Medical Image Segmentation Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Nova Information Management School (NOVA IMS), Universidade Nova de Lisboa, Campus de Campolide, 1070-312 Lisboa, Portugal

Funding

Faculdade de Ciências e Tecnologia, Universidade Nova de Lisboa · Slovenian Research Agency

References (70)

Show source-provided references
1. The worldwide epidemiology of type 2 diabetes mellitus—Present and future perspectives10.1038/nrendo.2011.183 ↗
2. IDF Diabetes Atlas: Global estimates of diabetes prevalence for 2017 and projections for 204510.1016/j.diabres.2018.02.023 ↗
3. Diabetes Mellitus: A Review on Pathophysiology, Current Status of Oral Medications and Future Perspectives
4. Chronic Complications of Diabetes Mellitus: A Mini Review10.2174/1573399812666151016101622 ↗
5. Diabetic Retinopathy: Present and Past10.1016/j.procs.2018.05.074 ↗
6. The Worldwide Epidemic of Diabetic Retinopathy10.4103/0301-4738.100542 ↗
7. Causes of vision loss worldwide, 1990–2010: A systematic analysis10.1016/S2214-109X(13)70113-X ↗
8. Role of Early Screening for Diabetic Retinopathy in Patients with Diabetes Mellitus: An Overview10.4103/0970-0218.91324 ↗
9. Automated Detection of Diabetic Retinopathy: Barriers to Translation into Clinical Practice10.1586/erd.09.76 ↗
10. Proposed international clinical diabetic retinopathy and diabetic macular edema disease severity scales10.1016/S0161-6420(03)00475-5 ↗
11. Mitchell, T.M. (1997). Machine Learning, McGraw-Hill Inc.. [1st ed.].
12. Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, The MIT Press.
13. Backpropagation Applied to Handwritten Zip Code Recognition10.1162/neco.1989.1.4.541 ↗
14. Krizhevsky, A., Sutskever, I., and Hinton, G. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Neural Information Processing Systems, Curran Associates Inc.
15. ImageNet Large Scale Visual Recognition Challenge10.1007/s11263-015-0816-y ↗
16. Collobert, R., and Weston, J. (2008). A Unified Architecture for Natural Language Processing: Deep Neural Networks with Multitask Learning. Proceedings of the 25th International Conference on Machine Learning, ACM.10.1145/1390156.1390177 ↗
17. Dos Santos, C., and Gatti de Bayser, M. (2014). Deep Convolutional Neural Networks for Sentiment Analysis of Short Texts. Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics, Dublin City University and Association for Computational Linguistics.
18. Kalchbrenner, N., Grefenstette, E., and Blunsom, P. (2014). A Convolutional Neural Network for Modelling Sentences. arXiv.10.3115/v1/P14-1062 ↗
19. Convolutional neural networks for time series classification10.21629/JSEE.2017.01.18 ↗
20. Wang, Z., Yan, W., and Oates, T. (2017, January 14–19). Time series classification from scratch with deep neural networks: A strong baseline. Proceedings of the 2017 International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, USA.10.1109/IJCNN.2017.7966039 ↗
21. Diabetic retinopathy detection through artificial intelligent techniques: A review and open issues
22. A Review on Recent Developments for Detection of Diabetic Retinopathy10.1155/2016/6838976 ↗
23. Review of methods for diabetic retinopathy detection and severity classification10.15623/ijret.2014.0303115 ↗
24. Automated Screening for Diabetic Retinopathy–A Systematic Review10.1159/000486284 ↗
25. Artificial intelligence in diabetic retinopathy: A natural step to the future10.4103/ijo.IJO_1989_18 ↗
26. Dumoulin, V., and Visin, F. (2016). A Guide to Convolution Arithmetic for Deep Learning. arXiv.
27. Xu, B., Wang, N., Chen, T., and Li, M. (2015). Empirical Evaluation of Rectified Activations in Convolutional Network. arXiv.
28. Rectified Linear Units Improve Restricted Boltzmann Machines Vinod Nair
29. Maas, A.L., Hannun, A.Y., and Ng, A.Y. (2013, January 16). Rectifier nonlinearities improve neural network acoustic models. Proceedings of the ICML Workshop on Deep Learning for Audio, Speech, and Language Processing, Atlanta, GA, USA.
30. Ouahabi, A. (2013, January 12–15). A review of wavelet denoising in medical imaging. Proceedings of the 2013 8th International Workshop on Systems, Signal Processing and their Applications (WoSSPA), Algiers, Algeria.10.1109/WoSSPA.2013.6602330 ↗
31. Scherer, D., Müller, A., and Behnke, S. (2010). Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition, Springer.10.1007/978-3-642-15825-4_10 ↗
32. Dropout: A Simple Way to Prevent Neural Networks from Overfitting
33. Chollet, F. (2017). Deep Learning with Python, Manning Publications Co.. [1st ed.].
34. James, G., Witten, D., Hastie, T., Tibshirani, R., Trevor Hastie, G.J., and Robert Tibshirani, D.W. (2014). An Introduction to Statistical Learning: With Applications in R., Springer Publishing Company.10.1007/978-1-4614-7138-7 ↗
35. Ioffe, S., and Szegedy, C. (2015). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Proceedings of the 32nd International Conference on Machine Learning Lille, France - Volume 37, ACM.
36. Santurkar, S., Tsipras, D., Ilyas, A., and Madry, A. (2018). How Does Batch Normalization Help Optimization?. Advances in Neural Information Processing Systems 31, Curran Associates, Inc.
37. Deng, J., Dong, W., Socher, R., Li, L., Li, K., and Fei-Fei, L. (2009, January 20–25). ImageNet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
38. Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N.D., and Weinberger, K.Q. (2014). How Transferable are Features in Deep Neural Networks, Curran Associates, Inc.
39. Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning10.1109/TMI.2016.2528162 ↗
40. Kornblith, S., Shlens, J., and Le, Q. (2019, January 16–21). Do Better ImageNet Models Transfer Better. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00277 ↗
41. Alom, M.Z., Taha, T., Yakopcic, C., Westberg, S., Hasan, M., C Van Esesn, B., Awwal, A., and Asari, V. (2018). The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches. arXiv.
42. Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv.
43. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
44. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
45. Huang, G., Liu, Z., Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely Connected Convolutional Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
46. Chollet, F. (2017, January 21–26). Xception: Deep Learning with Depthwise Separable Convolutions. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
47. EyePACS: An Adaptable Telemedicine System for Diabetic Retinopathy Screening10.1177/193229680900300315 ↗
48. Feedback on a publicly distributed image database: The Messidor database10.5566/ias.1155 ↗
49. Automated analysis of retinal images for detection of referable diabetic retinopathy10.1001/jamaophthalmol.2013.1743 ↗
50. Pires, R., Jelinek, H.F., Wainer, J., Valle, E., and Rocha, A. (2014). Advancing Bag-of-Visual-Words Representations for Lesion Classification in Retinal Images. PLoS ONE, 9.10.1371/journal.pone.0096814 ↗
51. TeleOphta: Machine learning and image processing methods for teleophthalmology10.1016/j.irbm.2013.01.010 ↗
52. The discrimination of similarly colored objects in computer images of the ocular fundus
53. Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs10.1001/jama.2016.17216 ↗
54. Masood, S., Luthra, T., Sundriyal, H., and Ahmed, M. (2017, January 5–6). Identification of Diabetic Retinopathy in Eye Images Using Transfer Learning. Proceedings of the 2017 International Conference on Computing, Communication and Automation (ICCCA), Greater Noida, Indian.10.1109/CCAA.2017.8229977 ↗
55. Li, X., Pang, T., Xiong, B., Liu, W., Liang, P., and Wang, T. (2017, January 14–16). Convolutional neural networks based transfer learning for diabetic retinopathy fundus image classification. Proceedings of the 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), Shanghai, China.10.1109/CISP-BMEI.2017.8301998 ↗
56. Mohammadian, S., Karsaz, A., and Roshan, Y.M. (December, January 30). Comparative Study of Fine-Tuning of Pre-Trained Convolutional Neural Networks for Diabetic Retinopathy Screening. Proceedings of the 24th National and 2nd International Iranian Conference on Biomedical Engineering (ICBME), Tehran, Iran.
57. Takahashi, H., Tampo, H., Arai, Y., Inoue, Y., and Kawashima, H. (2017). Applying artificial intelligence to disease staging: Deep learning for improved staging of diabetic retinopathy. PLoS ONE, 12.10.1371/journal.pone.0179790 ↗
58. Choi, J.Y., Yoo, T.K., Seo, J.G., Kwak, J., Um, T.T., and Rim, T.H. (2017). Multi-categorical deep learning neural network to classify retinal images: A pilot study employing small database. PLoS ONE, 12.10.1371/journal.pone.0187336 ↗
59. Wang, X., Lu, Y., Wang, Y., and Chen, W. (2018, January 6–9). Diabetic Retinopathy Stage Classification Using Convolutional Neural Networks. Proceedings of the 2018 IEEE International Conference on Information Reuse and Integration (IRI), Salt Lake City, UT, USA.10.1109/IRI.2018.00074 ↗
60. Early Detection of Diabetic Retinopathy by Using Deep Learning Neural Network
61. Retinal Lesion Detection With Deep Learning Using Image Patches10.1167/iovs.17-22721 ↗
62. Automated Detection of Diabetic Retinopathy Using Deep Learning
63. Deep convolutional neural networks for diabetic retinopathy detection by image classification10.1016/j.compeleceng.2018.07.042 ↗
64. Xu, X., Lin, J., Tao, Y., and Wang, X. (December, January 30). An Improved DenseNet Method Based on Transfer Learning for Fundus Medical Images. Proceedings of the 7th International Conference on Digital Home (ICDH), Guilin, China.
65. Tsighe Hagos, M., and Kant, S. (2019). Transfer Learning based Detection of Diabetic Retinopathy from Small Dataset. arXiv.
66. Chen, H., Zeng, X., Luo, Y., and Ye, W. (2019, January 19–21). Detection of Diabetic Retinopathy using Deep Neural Network. Proceedings of the International Conference on Digital Signal Processing (DSP), Shanghai, China.10.1109/ICDSP.2018.8631882 ↗
67. Automated diabetic retinopathy detection based on binocular siamese-like convolutional neural network10.1109/ACCESS.2019.2903171 ↗
68. Automated identification and grading system of diabetic retinopathy using deep neural networks10.1016/j.knosys.2019.03.016 ↗
69. Carneiro, G., and You, S. (2019). Enhanced Detection of Referable Diabetic Retinopathy via DCNNs and Transfer Learning BT-Computer Vision–ACCV 2018 Workshops, Springer International Publishing.
70. Diagnosis of Diabetic Retinopathy Using Deep Neural Networks10.1109/ACCESS.2018.2888639 ↗