Deep Learning for Image Segmentation: A Focus on Medical Imaging
Source abstract
Abstract
Image segmentation is crucial for various research areas. Many computer vision applications depend on segmenting images to understand the scene, such as autonomous driving, surveillance systems, robotics, and medical imaging. With the recent advances in deep learning (DL) and its confounding results in image segmentation, more attention has been drawn to its use in medical image segmentation. This article introduces a survey of the state-of-the-art deep convolution neural network (CNN) models and mechanisms utilized in image segmentation. First, segmentation models are categorized based on their model architecture and primary working principle. Then, CNN categories are described, and various models are discussed within each category. Compared with other existing surveys, several applications with multiple architectural adaptations are discussed within each category. A comparative summary is included to give the reader insights into utilized architectures in different applications and datasets. This study focuses on medical image segmentation applications, where the most widely used architectures are illustrated, and other promising models are suggested that have proven their success in different domains. Finally, the present work discusses current limitations and solutions along with future trends in the field.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · AI in cancer detection · Medical Image Segmentation Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (100+)
Show source-provided references
1. SegFast-V2: Semantic image segmentation with less parameters in deep learning for autonomous driving10.1007/s13042-019-01005-5 ↗
2. Deep learning-based image recognition for autonomous driving
3. Guiding intelligent surveillance system by learning-by-synthesis gaze estimation10.1016/j.patrec.2019.02.008 ↗
4. Multi-person tracking in smart surveillance system for crowd counting and normal/abnormal events detection
5. U-net: Convolutional networks for biomedical image segmentation10.1007/978-3-319-24574-4_28 ↗
6. V-Net: Fully convolutional neural networks for volumetric medical image segmentation
7. A threshold selection method from gray-level histograms10.1109/TSMC.1979.4310076 ↗
8. Statistical region merging10.1109/TPAMI.2004.110 ↗
9. Image segmentation using K-means clustering algorithm and subtractive clustering algorithm10.1016/j.procs.2015.06.090 ↗
10. Snakes: Active contour models10.1007/BF00133570 ↗
11. Fast approximate energy minimization via graph cuts10.1109/34.969114 ↗
12. Multi-class image segmentation using conditional random fields and global classification
13. Reducing graphs in graph cut segmentation
14. Image segmentation using deep learning: A survey
15. Imagenet: A large-scale hierarchical image database
16. The pascal visual object classes (VOC) challenge10.1007/s11263-009-0275-4 ↗
17. Microsoft COCO: Common objects in context10.1007/978-3-319-10602-1_48 ↗
18. LDLCT an instance-based framework for lesion detection on lung CT scans
19. DeepLung: Deep 3D dual path nets for automated pulmonary nodule detection and classification
20. Automatic abdominal multi-organ segmentation using deep convolutional neural network and time-implicit level sets10.1007/s11548-016-1501-5 ↗
21. U-Net: Deep learning for cell counting, detection and morphometry10.1038/s41592-018-0261-2 ↗
22. Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions10.1186/s40537-021-00444-8 ↗
23. Rectified linear units improve restricted boltzmann machines vinod
24. Rectifier nonlinearities improve neural network acoustic models
25. 3D U-Net: Learning dense volumetric segmentation from sparse annotation
26. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs10.1001/jama.2016.17216 ↗
27. Exploring fmri results space: 31 variants of an fmri analysis in afni, fsl and spm10.3389/fninf.2016.00024 ↗
28. 3D deep learning on medical images: A review10.3390/s20185097 ↗
29. GA-UNet: UNet-based framework for segmentation of 2D and 3D medical images applicable on heterogeneous datasets10.1007/s00521-021-06134-z ↗
30. Ra-UNet: A hybrid deep attention-aware network to extract liver and tumor in CT scans10.3389/fbioe.2020.605132 ↗
31. K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” arXiv Preprint arXiv:1409.1556 [cs.CV], 2015.
32. K. He, X. Zhang, S. Ren and J. Sun, “Deep residual learning for image recognition,” arXiv Preprint arXiv:1512.03385 [cs.CV], 2015.10.1109/CVPR.2016.90 ↗
33. Going deeper with convolutions
34. Xception: Deep learning with depthwise separable convolutions
35. Rigid-motion scattering for texture classification
36. Fully convolutional networks for semantic segmentation
37. W. Liu, A. Rabinovich and A. C. Berg, “Parsenet: Looking wider to see better,” arXiv Preprint arXiv:1506.04579v2 [cs.CV], 2015.
38. Automated cardiovascular magnetic resonance image analysis with fully convolutional networks10.1186/s12968-018-0471-x ↗
39. Deep supervision for pancreatic cyst segmentation in abdominal CT scans10.1007/978-3-319-66179-7_26 ↗
40. Three-dimensional CT image segmentation by combining 2D fully convolutional network with 3D majority voting10.1007/978-3-319-46976-8_12 ↗
41. Organ segmentation from full-size CT images using memory-efficient FCN
42. Segmentation of the multimodal brain tumor image used the multi-pathway architecture method based on 3D FCN10.1016/j.neucom.2020.10.031 ↗
43. Adaen-Net: An ensemble of adaptive 2D–3D fully convolutional networks for medical image segmentation10.1016/j.neunet.2020.03.007 ↗
44. Multi-modal PixelNet for brain tumor segmentation in fully convolutional network with hypercolumn features for brain tumor segmentation
45. Learning deconvolution network for semantic segmentation
46. Segnet: A deep convolutional encoder-decoder architecture for image segmentation10.1109/TPAMI.2016.2644615 ↗
47. Dense deconvolutional network for semantic segmentation
48. Linknet: Exploiting encoder representations for efficient semantic segmentation
49. X. Xia and B. Kulis, “W-Net: A deep model for fully unsupervised image segmentation,” arXiv Preprint arXiv:1711.08506v1, 2017.
50. Automatic segmentation of pulmonary lobes using a progressive dense v-network10.1007/978-3-030-00889-5_32 ↗
51. Kidney and renal tumor segmentation using a hybrid v-net-based model10.3390/math8101772 ↗
52. Block level skip connections across cascaded V-Net for multi-organ segmentation10.1109/TMI.2020.2975347 ↗
53. Segthor: Segmentation of thoracic organs at risk in CT images
54. A variant form of 3D-UNet for infant brain segmentation10.1016/j.future.2019.11.021 ↗
55. Benchmark on automatic six-month-old infant brain segmentation algorithms: The iSeg-2017 challenge10.1109/TMI.2019.2901712 ↗
56. Dense-unet: A novel multiphoton in vivo cellular image segmentation model based on a convolutional neural network10.21037/qims-19-1090 ↗
57. Tmd-unet: Triple-unet with multi-scale input features and dense skip connection for medical image segmentation10.3390/healthcare9010054 ↗
58. Chen · Deep learning in healthcare · 2020 · 171 · 1710.1007/978-3-030-32606-7_2 ↗
59. S. Ranjbar, K. W. Singleton, L. Curtin, C. R. Rickertsen, L. E. Paulson et al., “Robust automatic whole brain extraction on magnetic resonance imaging of brain tumor patients using dense-vnet,” arXiv Preprint arXiv:2006.02627, 2020.
60. Unet++: A nested u-net architecture for medical image segmentation10.1007/978-3-030-00889-5_1 ↗
61. H-DenseUNet: Hybrid densely connected UNet for liver and tumor segmentation from CT volumes10.1109/TMI.2018.2845918 ↗
62. Esophageal tumor segmentation in CT images using dilated dense attention Unet (DDAUnet)10.1109/ACCESS.2021.3096270 ↗
63. Rich feature hierarchies for accurate object detection and semantic segmentation
64. Survey on semantic segmentation using deep learning techniques10.1016/j.neucom.2019.02.003 ↗
65. Selective search for object recognition10.1007/s11263-013-0620-5 ↗
66. Support-vector networks10.1007/BF00994018 ↗
67. Fast R-CNN
68. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
69. Faster R-CNN features for instance search
70. Accurate pulmonary nodule detection in computed tomography images using deep convolutional neural networks10.1007/978-3-319-66179-7_64 ↗
71. Fast multiple landmark localisation using a patch-based iterative network10.1007/978-3-030-00928-1_64 ↗
72. Deeplesion: Automated mining of large-scale lesion annotations and universal lesion detection with deep learning10.1117/1.JMI.5.3.036501 ↗
73. Validation, comparison and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge10.1016/j.media.2017.06.015 ↗
74. The lung image database consortium (LIDC) and image database resource initiative (IDRI): A completed reference database of lung nodules on CT scans10.1118/1.3528204 ↗
75. Mask R-CNN
76. Breast tumor segmentation in 3D automatic breast ultrasound using mask scoring R-CNN10.1002/mp.14569 ↗
77. Ischemic lesion segmentation using ensemble of multi-scale region aligned CNN10.1016/j.cmpb.2020.105831 ↗
78. ISLES 2015-A public evaluation benchmark for ischemic stroke lesion segmentation from multispectral MRI10.1016/j.media.2016.07.009 ↗
79. Learning hierarchical features for scene labeling10.1109/TPAMI.2012.231 ↗
80. Feature pyramid networks for object detection
81. Pyramid scene parsing network
82. Spatial pyramid pooling in deep convolutional networks for visual recognition10.1007/978-3-319-10578-9_23 ↗
83. Image segmentation with pyramid dilated convolution based on ResNet and U-Net10.1007/978-3-319-70096-0_38 ↗
84. Pydinet: Pyramid dilated network for medical image segmentation10.1016/j.neunet.2021.03.023 ↗
85. Unified multi-scale feature abstraction for medical image segmentation
86. The liver tumor segmentation benchmark (LiTS)
87. Hierarchical spatial pyramid network for cervical precancerous segmentation by reconstructing deep segmentation networks
88. Z. Zhuangzhuang, B. Sun and W. Zhang, “Pyramid medical transformer for medical image segmentation,” ArXiv Preprint ArXiv: 2104.14702, 2021.
89. An improved mask R-CNN model for multiorgan segmentation
90. Echocardiographic image multi-structure segmentation using Cardiac-SegNet10.1002/mp.14818 ↗
91. Semantic segmentation with reverse attention
92. Dual attention network for scene segmentation
93. Pyramid attention network for semantic segmentation
94. Ca-Net: Comprehensive attention convolutional neural networks for explainable medical image segmentation10.1109/TMI.2020.3035253 ↗
95. Enhancing U-net with spatial-channel attention gate for abnormal tissue segmentation in medical imaging
96. Multi-scale self-guided attention for medical image segmentation10.1109/JBHI.2020.2986926 ↗
97. Liver segmentation in abdominal CT images via auto-context neural network and self-supervised contour attention10.1016/j.artmed.2021.102023 ↗
98. Global channel attention networks for intracranial vessel segmentation10.1016/j.compbiomed.2020.103639 ↗
99. Automatic lumbar spinal MRI image segmentation with a multi-scale attention network10.1007/s00521-021-05856-4 ↗
100. 3d image reconstruction for comparison of algorithm database: A patient specific anatomical and medical image database