FPN-SE-ResNet Model for Accurate Diagnosis of Kidney Tumors Using CT Images
Source abstract
Abstract
Kidney tumors are a significant health concern. Early detection and accurate segmentation of kidney tumors are crucial for timely and effective treatment, which can improve patient outcomes. Deep learning techniques, particularly Convolutional Neural Networks (CNNs), have shown great promise in medical image analysis, including identifying and segmenting kidney tumors. Computed tomography (CT) scans of kidneys aid in tumor assessment and morphology studies, employing semantic segmentation techniques for precise pixel-level identification of kidneys and surrounding anatomical structures. This paper proposes a Squeeze-and-Excitation-ResNet (SE-ResNet) model for segmentation by combining the encoder stage of SE-ResNet with the Feature Pyramid Network (FPN). The performance of the proposed SE-ResNet model is evaluated using the Intersection over Union (IoU) and F1-score metrics. Experimental results demonstrate that the SE-ResNet models achieve impressive IoU scores for background, kidney, and tumor segmentation, with mean IoU scores ranging from 0.988 to 0.981 for Seresnet50 and Seresnet18, respectively. Notably, Seresnet50 exhibits the highest IoU score for kidney segmentation. These findings suggest that SE-ResNet models accurately identify and segment regions of interest in CT images of renal carcinoma, with higher model versions generally exhibiting superior performance. The proposed Seresnet50 model is a good tool for accurate tumor detection and image classification, aiding medical professionals in early diagnosis and timely intervention.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Renal cell carcinoma treatment · Radiomics and Machine Learning in Medical Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mathematics, Statistics and Computer Science, University of KwaZulu-Natal, Durban 4000, South Africa
References (89)
Show source-provided references
1. Human Symptoms-Disease Network10.1038/ncomms5212 ↗
2. Diagnostic Reasoning in Action10.1109/21.247883 ↗
3. Three Approaches to Understanding and Classifying Mental Disorder: ICD-11, DSM-5, and the National Institute of Mental Health’s Research Domain Criteria (RDoC)10.1177/1529100617727266 ↗
4. Section of Otology10.1136/bmj.2.1821.1289 ↗
5. Toward an Ontological Treatment of Disease and Diagnosis Department of Pathology and Division of Biomedical Informatics, University of Texas
6. The Science of Clinical Practice: Disease Diagnosis or Patient Prognosis? Evidence about “What Is Likely to Happen” Should Shape Clinical Practice10.1186/s12916-014-0265-4 ↗
7. Fuzzy Logic in Medicine and Bioinformatics10.1155/JBB/2006/91908 ↗
8. Alam, R., Cheraghi-Sohi, S., Panagioti, M., Esmail, A., Campbell, S., and Panagopoulou, E. (2017). Managing Diagnostic Uncertainty in Primary Care: A Systematic Critical Review. BMC Fam. Pract., 18.10.1186/s12875-017-0650-0 ↗
9. A Medical Decision Support System for Disease Diagnosis under Uncertainty10.1016/j.eswa.2017.06.031 ↗
10. An Analytical Method for Diseases Prediction Using Machine Learning Techniques10.1016/j.compchemeng.2017.06.011 ↗
11. A Hybrid Intelligent System for the Prediction of Parkinson’s Disease Progression Using Machine Learning Techniques10.1016/j.bbe.2017.09.002 ↗
12. Accuracy Improvement for Diabetes Disease Classification: A Case on a Public Medical Dataset10.1016/j.fiae.2017.09.006 ↗
13. Abdelrahman, A., and Viriri, S. (2022). Kidney Tumor Semantic Segmentation Using Deep Learning: A Survey of State-of-the-Art. J. Imaging, 8.10.3390/jimaging8030055 ↗
14. Salih, O., and Duffy, K.J. (2023). Optimization Convolutional Neural Network for Automatic Skin Lesion Diagnosis Using a Genetic Algorithm. Appl. Sci., 13.10.3390/app13053248 ↗
15. Changes in Breast Cancer Detection and Mammography Recall Rates after the Introduction of a Computer-Aided Detection System10.1093/jnci/djh067 ↗
16. Can Computer-Aided Detection with Double Reading of Screening Mammograms Help Decrease the False-Negative Rate? Initial Experience10.1148/radiol.2322030034 ↗
17. Computer-Aided Diagnosis in Medical Imaging: Historical Review, Current Status and Future Potential10.1016/j.compmedimag.2007.02.002 ↗
18. Salih, O., and Viriri, S. (2020). Skin Lesion Segmentation Using Stochastic Region-Merging and Pixel-Based Markov Random Field. Symmetry, 12.10.3390/sym12081224 ↗
19. Computer-Aided Diagnosis in Thoracic CT10.1053/j.sult.2005.07.001 ↗
20. Liu, Y.Y., Huang, Z.H., and Huang, K.W. (2022). Deep Learning Model for Computer-Aided Diagnosis of Urolithiasis Detection from Kidney–Ureter–Bladder Images. Bioengineering, 9.10.3390/bioengineering9120811 ↗
21. AI in Medical Imaging Informatics: Current Challenges and Future Directions10.1109/JBHI.2020.2991043 ↗
22. Lim, E.J., Castellani, D., So, W.Z., Fong, K.Y., Li, J.Q., Tiong, H.Y., Gadzhiev, N., Heng, C.T., Teoh, J.Y.C., and Naik, N. (2022). Radiomics in Urolithiasis: Systematic Review of Current Applications, Limitations, and Future Directions. J. Clin. Med., 11.10.3390/jcm11175151 ↗
23. The Role of Imaging in Head and Neck Cancer: An Overview of Different Imaging Modalities in Primary Diagnosis and Staging of the Disease10.5114/jcb.2020.100386 ↗
24. Artificial Intelligence in Cancer Imaging: Clinical Challenges and Applications10.3322/caac.21552 ↗
25. Optimized Machine Learning Methods for Prediction of Cognitive Outcome in Parkinson’s Disease10.1016/j.compbiomed.2019.103347 ↗
26. Gradient-Based Learning Applied to Document Recognition10.1109/5.726791 ↗
27. A Survey on Deep Learning in Medical Image Analysis10.1016/j.media.2017.07.005 ↗
28. Convolutional Neural Networks in Medical Image Understanding: A Survey10.1007/s12065-020-00540-3 ↗
29. Computer-Aided Diagnosis in the Era of Deep Learning10.1002/mp.13764 ↗
30. A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects10.1109/TNNLS.2021.3084827 ↗
31. Does Manual Delineation Only Provide the Side Information in CT Prostate Segmentation?10.1007/978-3-319-66179-7_79 ↗
32. Automatic Magnetic Resonance Image Prostate Segmentation Based on Adaptive Feature Learning Probability Boosting Tree Initialization and CNN-ASM Refinement10.1109/ACCESS.2017.2781278 ↗
33. CardiacNET: Segmentation of Left Atrium and Proximal Pulmonary Veins from MRI Using Multi-View CNN10.1007/978-3-319-66185-8_43 ↗
34. 2D-3D Fully Convolutional Neural Networks for Cardiac MR Segmentation10.1007/978-3-319-75541-0_14 ↗
35. Automatic Segmentation of MR Brain Images with a Convolutional Neural Network10.1109/TMI.2016.2548501 ↗
36. Interactive Medical Image Segmentation Using Deep Learning with Image-Specific Fine Tuning10.1109/TMI.2018.2791721 ↗
37. Computer Methods and Programs in Biomedicine Fusion-Based Tensor Radiomics Using Reproducible Features: Application to Survival Prediction in Head and Neck Cancer10.1016/j.cmpb.2023.107714 ↗
38. Salmanpour, M.R., Rezaeijo, S.M., Hosseinzadeh, M., and Rahmim, A. (2023). Deep versus Handcrafted Tensor Radiomics Features: Prediction of Survival in Head and Neck Cancer Using Machine Learning and Fusion Techniques. Diagnostics, 13.10.3390/diagnostics13101696 ↗
39. Machine Learning Approach for Automated Predicting of COVID-19 Severity Based on Clinical and Paraclinical Characteristics: Serum Levels of Zinc, Calcium, and Vitamin D10.1016/j.clnesp.2022.07.011 ↗
40. Lee, K., Zung, J., Li, P., Jain, V., and Seung, H.S. (2017). Superhuman Accuracy on the SNEMI3D Connectomics Challenge. arXiv.
41. Isensee, F., Petersen, J., Klein, A., Zimmerer, D., Jaeger, P.F., Kohl, S., Wasserthal, J., Koehler, G., Norajitra, T., and Wirkert, S. (2019). NnU-Net: Self-Adapting Framework for U-Net-Based Medical Image Segmentation. Inform. Aktuell, 22.10.1007/978-3-658-25326-4_7 ↗
42. Evaluation of Multislice Inputs to Convolutional Neural Networks for Medical Image Segmentation10.1002/mp.14391 ↗
43. Renal-Cell Carcinoma10.1056/NEJM199609193351207 ↗
44. Liu, J., Yildirim, O., Akin, O., and Tian, Y. (2023). AI-Driven Robust Kidney and Renal Mass Segmentation and Classification on 3D CT Images. Bioengineering, 10.10.3390/bioengineering10010116 ↗
45. Shehata, M., Abouelkheir, R.T., Gayhart, M., Van Bogaert, E., Abou El-Ghar, M., Dwyer, A.C., Ouseph, R., Yousaf, J., Ghazal, M., and Contractor, S. (2023). Role of AI and Radiomic Markers in Early Diagnosis of Renal Cancer and Clinical Outcome Prediction: A Brief Review. Cancers, 15.10.3390/cancers15102835 ↗
46. Cancer Statistics, 201510.3322/caac.21254 ↗
47. Renal Cell Carcinoma: Histological Classification and Correlation with Imaging Findings10.1590/0100-3984.2013.1927 ↗
48. The 2016 WHO Classification of Tumours of the Urinary System and Male Genital Organs—Part B: Prostate and Bladder Tumours10.1016/j.eururo.2016.02.028 ↗
49. Active Surveillance as the Preferred Management Option for Small Renal Masses10.5489/cuaj.10038 ↗
50. The Prevalence of Renal Cell Carcinoma Diagnosed at Autopsy10.1111/j.1464-410X.2005.05243.x ↗
51. Nadimi-Shahraki, M.H., Taghian, S., Mirjalili, S., and Abualigah, L. (2022). Binary Aquila Optimizer for Selecting Effective Features from Medical Data: A COVID-19 Case Study. Mathematics, 10.10.3390/math10111929 ↗
52. Segmentation of the Prostate, Its Zones, Anterior Fibromuscular Stroma, and Urethra on the MRIs and Multimodality Image Fusion Using U-Net Model10.21037/qims-22-115 ↗
53. Ekinci, S., Izci, D., Eker, E., and Abualigah, L. (2023). An Effective Control Design Approach Based on Novel Enhanced Aquila Optimizer for Automatic Voltage Regulator, Springer.10.1007/s10462-022-10216-2 ↗
54. Deep Learning Models in Medical Image Analysis10.1016/j.job.2022.03.003 ↗
55. Navab, N., Hornegger, J., Wells, W.M., and Frangi, A.F. (2015). BT—Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015, Springer International Publishing.10.1007/978-3-319-24553-9 ↗
56. Yang, G., Li, G., Pan, T., and Kong, Y. (2018, January 20–24). Automatic Segmentation of Kidney and Renal Tumor in CT Images Based on 3D Fully Convolutional Neural Network with Pyramid Pooling Module. Proceedings of the 2018 24th International Conference on Pattern Recognition (ICPR), Beijing, China.10.1109/ICPR.2018.8545143 ↗
57. Esophagus Segmentation from Planning CT Images Using an Atlas-Based Deep Learning Approach10.1016/j.cmpb.2020.105685 ↗
58. Ducros, N., Mur, A.L., and Peyrin, F. (2020, January 3–7). A Completion Network for Reconstruction from Compressed Acquisition. Proceedings of the IEEE 17th International Symposium on Biomedical Imaging (ISBI), Iowa City, IA, USA.10.1109/ISBI45749.2020.9098390 ↗
59. Türk, F., Lüy, M., and Barışçı, N. (2020). Kidney and Renal Tumor Segmentation Using a Hybrid V-Net-Based Model. Mathematics, 8.10.3390/math8101772 ↗
60. Computer-Aided Kidney Segmentation on Abdominal CT Images10.1109/TITB.2005.855561 ↗
61. Implementation of Stimulated Raman Scattering Microscopy for Single Cell Analysis10.1117/12.2266776 ↗
62. Khalifa, F., Gimel’farb, G., Abo El-Ghar, M., Sokhadze, G., Manning, S., McClure, P., Ouseph, R., and El-Baz, A. (2011, January 11–14). A New Deformable Model-Based Segmentation Approach for Accurate Extraction of the Kidney from Abdominal CT Images. Proceedings of the 18th IEEE International Conference on Image Processing, Brussels, Belgium.10.1109/ICIP.2011.6116438 ↗
63. Yang, G., Gu, J., Chen, Y., Liu, W., Tang, L., Shu, H., and Toumoulin, C. (2014, January 26–30). Automatic Kidney Segmentation in CT Images Based on Multi-Atlas Image Registration. Proceedings of the 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, USA.
64. Automatic Detection and Segmentation of Kidneys in 3D CT Images Using Random Forests10.1007/978-3-642-33454-2_9 ↗
65. 3D Fast Automatic Segmentation of Kidney Based on Modified AAM and Random Forest10.1109/TMI.2015.2512606 ↗
66. A Deep Learning-Based Precision and Automatic Kidney Segmentation System Using Efficient Feature Pyramid Networks in Computed Tomography Images10.1016/j.cmpb.2022.106854 ↗
67. Heller, N., Sathianathen, N., Kalapara, A., Walczak, E., Moore, K., Kaluzniak, H., Rosenberg, J., Blake, P., Rengel, Z., and Oestreich, M. (2019). The KiTS19 Challenge Data: 300 Kidney Tumor Cases with Clinical Context, CT Semantic Segmentations, and Surgical Outcomes. arXiv.
68. BACH: Grand Challenge on Breast Cancer Histology Images10.1016/j.media.2019.05.010 ↗
69. Zhao, G., Ge, W., and Yu, Y. (2021, January 10–17). GraphFPN: Graph Feature Pyramid Network for Object Detection. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.10.1109/ICCV48922.2021.00276 ↗
70. Lin, T.-Y., Dollár, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature Pyramid Networks for Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
71. Liu, S., Qi, L., Qin, H., Shi, J., and Jia, J. (2019). PANet: Path Aggregation Network for Instance Segmentation. arXiv.10.1109/CVPR.2018.00913 ↗
72. ExFuse: Enhancing Feature Fusion for Semantic Segmentation10.1007/978-3-030-01249-6_17 ↗
73. Zigzagnet: Fusing Top-down and Bottom-up Context for Object Segmentation
74. Toshev, A., and Szegedy, C. (2014, January 23–28). Deeppose: Human Pose Estimation via Deep Neural Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.214 ↗
75. Wu, G., Ji, X., Yang, G., Jia, Y., and Cao, C. (2023). Signal-to-Image: Rolling Bearing Fault Diagnosis Using ResNet Family Deep-Learning Models. Processes, 11.10.3390/pr11051527 ↗
76. Se-ResNet with GAN Based Data Augmentation Applied to Acoustic Scene Classificaiton
77. ImageNet Classification with Deep Convolutional Neural Networks10.1145/3065386 ↗
78. Simonyan, K., and Zisserman, A. (2015, January 7–9). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the 3rd International Conference on Learning Representations—ICLR 2015, San Diego, CA, USA.
79. Deep Learning10.1038/nature14539 ↗
80. Taha, A.A., and Hanbury, A. (2015). Metrics for Evaluating 3D Medical Image Segmentation: Analysis, Selection, and Tool. BMC Med. Imaging, 15.10.1186/s12880-015-0068-x ↗
81. Statistical Validation Metric for Accuracy Assessment in Medical Image Segmentation10.1007/s11548-007-0125-1 ↗
82. Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2017, January 21–26). Focal Loss for Dense Object Detection. Proceedings of the IEEE International Conference on Computer Vision, Honolulu, HI, USA.10.1109/ICCV.2017.324 ↗
83. Segmentation of Head and Neck Organs at Risk Using CNN with Batch Dice Loss10.1007/978-3-030-12939-2_8 ↗
84. Rethinking the Dice Loss for Deep Learning Lesion Segmentation in Medical Images10.1007/s12204-021-2264-x ↗
85. Milletari, F., Navab, N., and Ahmadi, S.A. (2016, January 25–28). V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation. Proceedings of the 4th International Conference on 3D Vision (3DV), Stanford, CA, USA.10.1109/3DV.2016.79 ↗
86. Elharrouss, O., Akbari, Y., Almaadeed, N., and Al-Maadeed, S. (2022). Backbones-Review: Feature Extraction Networks for Deep Learning and Deep Reinforcement Learning Approaches. arXiv.
87. SRENet: A Spatiotemporal Relationship-Enhanced 2D-CNN-Based Framework for Staging and Segmentation of Kidney Cancer Using CT Images10.1007/s10489-022-04384-5 ↗
88. Kidney Tumor Segmentation Based on FR2PAttU-Net Model10.3389/fonc.2022.853281 ↗
89. EfficientNet Family U-Net Models for Deep Learning Semantic Segmentation of Kidney Tumors on CT Images10.3389/fcomp.2023.1235622 ↗