Lightweight Frequency Recalibration Network for Diabetic Retinopathy Multi-Lesion Segmentation
Source abstract
Abstract
Automated segmentation of diabetic retinopathy (DR) lesions is crucial for assessing DR severity and diagnosis. Most previous segmentation methods overlook the detrimental impact of texture information bias, resulting in suboptimal segmentation results. Additionally, the role of lesion shape is not thoroughly considered. In this paper, we propose a lightweight frequency recalibration network (LFRC-Net) for simultaneous multi-lesion DR segmentation, which integrates a frequency recalibration module into the bottleneck layers of the encoder to analyze texture information and shape features together. The module utilizes a Gaussian pyramid to generate features at different scales, constructs a Laplacian pyramid using a difference of Gaussian filter, and then analyzes object features in different frequency domains with the Laplacian pyramid. The high-frequency component handles texture information, while the low-frequency area focuses on learning the shape features of DR lesions. By adaptively recalibrating these frequency representations, our method can differentiate the objects of interest. In the decoder, we introduce a residual attention module (RAM) to enhance lesion feature extraction and efficiently suppress irrelevant information. We evaluate the proposed model’s segmentation performance on two public datasets, IDRiD and DDR, and a private dataset, an ultra-wide-field fundus images dataset. Extensive comparative experiments and ablation studies are conducted across multiple datasets. With minimal model parameters, our approach achieves an mAP_PR of 60.51%, 34.83%, and 14.35% for the segmentation of EX, HE, and MA on the DDR dataset and also obtains excellent results for EX and SE on the IDRiD dataset, which validates the effectiveness of our network.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Retinal Imaging and Analysis · Retinal Diseases and Treatments · Medical Image Segmentation Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
Department of Artificial Intelligence and Manufacturing, Hechi University, Hechi 546300, China
Funding
National Natural Science Foundation of China · Key Laboratory of AI and Information Processing, Education Department of Guangxi Zhuang Autonomous Region (Hechi University)
References (42)
Show source-provided references
1. Diabetic retinopathy and diabetic macular edema: Pathophysiology, screening, and novel therapies10.2337/diacare.26.9.2653 ↗
2. Singh, R.P. (2015). Managing Diabetic Eye Disease in Clinical Practice, Springer.10.1007/978-3-319-08329-2 ↗
3. Global prevalence of diabetes: Estimates for the year 2000 and projections for 203010.2337/diacare.27.5.1047 ↗
4. Diabetic retinopathy techniques in retinal images: A review10.1016/j.artmed.2018.10.009 ↗
5. A survey on medical image analysis in diabetic retinopathy10.1016/j.media.2020.101742 ↗
6. Guidelines on diabetic eye care: The international council of ophthalmology recommendations for screening, follow-up, referral, and treatment based on resource settings10.1016/j.ophtha.2018.04.007 ↗
7. Nassir, N., Joachim, H., William, M.W., and Alejandro, F.F. (2015). U-net: Convolutional networks for biomedical image segmentation. Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015: 18th International Conference, Springer.
8. Danail, S., Zeike, T., Gustavo, C., and Tanveer, S.M. (2018). Unet++: A nested u-net architecture for medical image segmentation. Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, Springer.
9. Anne, L.M., Purang, A., Danail, S., Dinana, M., Maria, A.Z.S., Kevin, K.Z., Daniel, R., and Leo, J. (2020). Pranet: Parallel reverse attention network for polyp segmentation. International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer.
10. TSCA-Net: Transformer based spatial-channel attention segmentation network for medical images10.1016/j.compbiomed.2024.107938 ↗
11. Bhavna, A., Huazhu, F., Cecilia, S.L., Tom, M., Yanwu, X., and Yalin, Z. (2022). Domain adaptive retinal vessel segmentation guided by high-frequency component. Ophthalmic Medical Image Analysis, Springer.
12. Li, H.J., Li, H., Shu, H., Chen, J.Y., Hu, Y., and Liu, J. (2023, January 18–21). Self-supervision boosted retinal vessel segmentation for cross-domain data. Proceedings of the 2023 IEEE 20th International Symposium on Biomedical Imaging (ISBI), Cartagena, Colombia.10.1109/ISBI53787.2023.10230561 ↗
13. An annotation-free restoration network for cataractous fundus images10.1109/TMI.2022.3147854 ↗
14. Azad, R., Bozorgpour, A., Asadi-Aghbolaghi, M., Merhof, D., and Escalera, S. (2021, January 11–17). Deep frequency re-calibration u-net for medical image segmentation. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCVW54120.2021.00366 ↗
15. Sandler, M., Howard, A., Zhu, M.L., Zhmoginov, A., and Chen, L.C. (2018, January 18–22). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
16. ImageNet classification with deep convolutional neural networks10.1145/3065386 ↗
17. Azad, R., Fayjie, A.R., Kauffmann, C., Ben Ayed, I., Pedersoli, M., and Dolz, J. (2021, January 11–17). On the texture bias for few-shot cnn segmentation. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/WACV48630.2021.00272 ↗
18. The origins and prevalence of texture bias in convolutional neural networks
19. Wang, Q.L., Wu, B.G., Zhu, P.F., Li, P.H., Zuo, W.M., and Hu, Q.H. (2020, January 14–19). ECA-Net: Efficient channel attention for deep convolutional neural networks. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seattle, WA, USA.10.1109/CVPR42600.2020.01155 ↗
20. Porwal, P., Pachade, S., Kamble, R., Kokare, M., Deshmukh, G., Sahasrabuddhe, V., and Meriaudeau, F. (2018). Indian diabetic retinopathy image dataset (IDRiD): A database for diabetic retinopathy screening research. Data, 3.10.3390/data3030025 ↗
21. Diagnostic assessment of deep learning algorithms for diabetic retinopathy screening10.1016/j.ins.2019.06.011 ↗
22. Igor, V.T., Vera, K., Pavel, K., and Fabian, T. (2019). A lightweight neural network for hard exudate segmentation of fundus image. Artificial Neural Networks and Machine Learning—ICANN 2019: Image Processing: 28th International Conference on Artificial Neural Networks, Springer.
23. U-net based method for automatic hard exudates segmentation in fundus images using inception module and residual connection10.1109/ACCESS.2020.3023273 ↗
24. Lee, C.H., and Ke, Y.H. (2021, January 25–27). Fundus images classification for diabetic retinopathy using deep learning. Proceedings of the 13th International Conference on Computer Modeling and Simulation, Melbourne, VIC, Australia.10.1145/3474963.3475849 ↗
25. Ameri, N., Shoeibi, N., and Abrishami, M. (2022, January 17–18). Segmentation of hard exudates in retina fundus images using BCDU-Net. Proceedings of the 2022 12th International Conference on Computer and Knowledge Engineering (ICCKE), Mashhad, Iran.10.1109/ICCKE57176.2022.9960101 ↗
26. Hemorrhage semantic segmentation in fundus images for the diagnosis of diabetic retinopathy by using a convolutional neural network10.1186/s40537-022-00632-0 ↗
27. Fakhri, K., Aurelio, C., and Alfred, Y. (2019). Improving lesion segmentation for diabetic retinopathy using adversarial learning. International Conference on Image Analysis and Recognition, Springer.
28. Dual-branch network with dual-sampling modulated dice loss for hard exudate segmentation in color fundus images
29. Vison transformer adapter-based hyperbolic embeddings for multi-lesion segmentation in diabetic retinopathy10.1038/s41598-023-38320-5 ↗
30. Segmentation of hard exudate lesions in color fundus image using two-stage CNN-based methods10.1016/j.eswa.2023.122742 ↗
31. Lesion-aware knowledge distillation for diabetic retinopathy lesion segmentation10.1007/s10489-024-05274-8 ↗
32. Guo, C.L., Szemenyei, M., Yi, Y.G., Xue, Y., Zhou, W., and Li, Y.Y. (2020, January 4–8). Dense residual network for retinal vessel segmentation. Proceedings of the ICASSP 2020—2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.10.1109/ICASSP40776.2020.9054290 ↗
33. Xie, S.N., and Tu, Z.W. (2015, January 7–13). Holistically-nested edge detection. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.164 ↗
34. Fakhri, K., Aurelio, C., and Alfred, Y. (2018). Encoder-decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Springer.
35. Fully dense UNet for 2-D sparse photoacoustic tomography artifact removal
36. L-Seg: An end-to-end unified framework for multi-lesion segmentation of fundus images10.1016/j.neucom.2019.04.019 ↗
37. RTNet: Relation transformer network for diabetic retinopathy multi-lesion segmentation10.1109/TMI.2022.3143833 ↗
38. DR-Net: Diabetic Retinopathy Detection with Fusion Multi-lesion Segmentation and Classification10.1007/s11042-023-14785-4 ↗
39. Diabetic retinopathy lesion segmentation using deep multi-scale framework10.1016/j.bspc.2023.105050 ↗
40. Guo, C.L., Szemenyei, M., Yi, Y.G., Wang, W.L., Chen, B.E., and Fan, C.Q. (2021, January 10–15). Sa-unet: Spatial attention u-net for retinal vessel segmentation. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.10.1109/ICPR48806.2021.9413346 ↗
41. Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N.Y., and Kainz, B. (2018). Attention u-net: Learning where to look for the pancreas. arXiv.
42. Guo, C.L., Szemenyei, M., Hu, Y.T., Wang, W.L., Zhou, W., and Yi, Y.G. (2021, January 6–11). Channel Attention Residual u-Net for Retinal Vessel Segmentation. Proceedings of the ICASSP 2021—2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada.10.1109/ICASSP39728.2021.9414282 ↗