Deep Multi-Scale and Attention-Based Architectures for Semantic Segmentation in Biomedical Imaging
Source abstract
Abstract
Semantic segmentation plays a foundational role in biomedical image analysis, providing precise information about cellular, tissue, and organ structures in both biological and medical imaging modalities. Traditional approaches often fail in the face of challenges such as low contrast, morphological variability, and densely packed structures. Recent advancements in deep learning have transformed segmentation capabilities through the integration of fine-scale detail preservation, coarse-scale contextual modeling, and multi-scale feature fusion. This work provides a comprehensive analysis of state-of-the-art deep learning models, including U-Net variants, attention-based frameworks, and Transformer-integrated networks, highlighting innovations that improve accuracy, generalizability, and computational efficiency. Key architectural components such as convolution operations, shallow and deep blocks, skip connections, and hybrid encoders are examined for their roles in enhancing spatial representation and semantic consistency. We further discuss the importance of hierarchical and instance-aware segmentation and annotation in interpreting complex biological scenes and multiplexed medical images. By bridging methodological developments with diverse application domains, this paper outlines current trends and future directions for semantic segmentation, emphasizing its critical role in facilitating annotation, diagnosis, and discovery in biomedical research.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Radiomics and Machine Learning in Medical Imaging · AI in cancer detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (100+)
Show source-provided references
1. PESA R-CNN: perihematomal edema guided scale adaptive R-CNN for hemorrhage segmentation10.1109/JBHI.2022.3220820 ↗
2. MaxSigNet: light learnable layer for semantic cell segmentation10.1016/j.bspc.2024.106464 ↗
3. FCL-Net: towards accurate edge detection via fine-scale corrective learning10.1016/j.neunet.2021.10.022 ↗
4. Oktay O, Schlemper J, Folgoc LL, Lee M, Heinrich M, Misawa K, et al. Attention u-net: learning where to look for the pancreas. arXiv:1804.03999. 2018.
5. Attention gated networks: learning to leverage salient regions in medical images10.1016/j.media.2019.01.012 ↗
6. SyConn2: dense synaptic connectivity inference for volume electron microscopy10.1038/s41592-022-01624-x ↗
7. Model-based processing scheme for quantitative 4-D cardiac MRI analysis10.1109/4233.992164 ↗
8. Breast ultrasound image segmentation: a coarse-to-fine fusion convolutional neural network10.1002/mp.15006 ↗
9. An efficient framework for lesion segmentation in ultrasound images using global adversarial learning and region-invariant loss10.1016/j.compbiomed.2024.108137 ↗
10. CSwinDoubleU-Net: a double U-shaped network combined with convolution and Swin Transformer for colorectal polyp segmentation10.1016/j.bspc.2023.105749 ↗
11. Cross-modality segmentation of ultrasound image with generative adversarial network and dual normalization network10.1016/j.patcog.2024.110953 ↗
12. Effect of dataset size, image quality, and image type on deep learning-based automatic prostate segmentation in 3D ultrasound10.1088/1361-6560/ac5a93 ↗
13. CFU-Net: a coarse-fine U-Net with multilevel attention for medical image segmentation
14. PAMSNet: a medical image segmentation network based on spatial pyramid and attention mechanism10.1016/j.bspc.2024.106285 ↗
15. CoT-UNet++: a medical image segmentation method based on contextual transformer and dense connection10.3934/mbe.2023364 ↗
16. DoubleU-NetPlus: a novel attention and context-guided dual U-Net with multi-scale residual feature fusion network for semantic segmentation of medical images10.1007/s00521-023-08493-1 ↗
17. Segmentation of leukocyte by semantic segmentation model: a deep learning approach10.1016/j.bspc.2020.102385 ↗
18. CSAP-UNet: convolution and self-attention paralleling network for medical image segmentation with edge enhancement10.1016/j.compbiomed.2024.108265 ↗
19. Robust semantic segmentation of retinal fluids from SD-OCT images using FAM-U-Net10.1016/j.bspc.2023.105481 ↗
20. A global activated feature pyramid network for tiny pest detection in the wild10.1007/s00138-022-01310-0 ↗
21. Hybrid token transformer for deep face recognition10.1016/j.patcog.2023.109443 ↗
22. Squeeze-and-excitation networks
23. FSOU-Net: feature supplement and optimization U-Net for 2D medical image segmentation10.3233/THC-220174 ↗
24. DR-Net: dual-rotation network with feature map enhancement for medical image segmentation10.1007/s40747-021-00525-4 ↗
25. SEA-NET: medical image segmentation network based on spiral squeeze-and-excitation and attention modules10.1186/s12880-024-01194-8 ↗
26. Notice of retraction: dien network: detailed information extracting network for detecting continuous circular capsulorhexis boundaries of cataracts10.1109/ACCESS.2020.3021490 ↗
27. CI-UNet: melding convnext and cross-dimensional attention for robust medical image segmentation10.1007/s13534-023-00341-4 ↗
28. Automated breast nuclei feature extraction for segmentation in histopathology images using Deep-CNN-based gaussian mixture model and color optimization technique
29. DENSE-INception U-net for medical image segmentation10.1016/j.cmpb.2020.105395 ↗
30. 3D AIR-UNet: attention-inception–residual-based U-Net for brain tumor segmentation from multimodal MRI
31. MVSI-Net: multi-view attention and multi-scale feature interaction for brain tumor segmentation10.1016/j.bspc.2024.106484 ↗
32. Dual-attention transformer-based hybrid network for multi-modal medical image segmentation10.1038/s41598-024-76234-y ↗
33. IEA-Net: internal and external dual-attention medical segmentation network with high-performance convolutional blocks10.1007/s10278-024-01217-4 ↗
34. DMSA-UNet: dual multi-scale attention makes UNet more strong for medical image segmentation10.1016/j.knosys.2024.112050 ↗
35. SenseNet: densely connected, fully convolutional network with bottleneck skip connection for image segmentation10.5573/IEIESPC.2024.13.4.328 ↗
36. Skip-AttSeqNet: Leveraging skip connection and attention-driven Seq2seq model to enhance eye movement event detection in Parkinson’s disease10.1016/j.bspc.2024.106862 ↗
37. Multimodal medical image segmentation using multi-scale context-aware network10.1016/j.neucom.2021.11.017 ↗
38. DESCINet: a hierarchical deep convolutional neural network with skip connection for long time series forecasting10.1016/j.eswa.2023.120246 ↗
39. SWTRU: star-shaped window transformer reinforced U-net for medical image segmentation10.1016/j.compbiomed.2022.105954 ↗
40. SIB-UNet: a dual encoder medical image segmentation model with selective fusion and information bottleneck fusion10.1016/j.eswa.2024.124284 ↗
41. USCT-UNet: rethinking the semantic gap in U-net network from U-shaped skip connections with multichannel fusion transformer10.1109/TNSRE.2024.3468339 ↗
42. SK-VM++: mamba assists skip-connections for medical image segmentation10.1016/j.bspc.2025.107646 ↗
43. Dual-method for semantic and instance brain tumor segmentation based on UNet and mask R-CNN using MRI
44. UTSN-net: medical image semantic segmentation model based on skip non-local attention module
45. SegQNAS: quantum-inspired neural architecture search applied to medical image semantic segmentation
46. A publicly available deep learning model and dataset for segmentation of breast, fibroglandular tissue, and vessels in breast MRI10.1038/s41598-024-54048-2 ↗
47. Detection of lungs tumors in CT scan images using convolutional neural networks10.1109/TCBB.2023.3315303 ↗
48. Positional influence on cellular transcriptional identity revealed through spatially segmented single-cell transcriptomics10.1016/j.cels.2023.05.003 ↗
49. MLDA-Net: multi-level deep aggregation network for 3D nuclei instance segmentation10.1109/JBHI.2025.3529464 ↗
50. Whole-cell segmentation of tissue images with human-level performance using large-scale data annotation and deep learning10.1038/s41587-021-01094-0 ↗
51. Unbiased image segmentation assessment toolkit for quantitative differentiation of state-of-the-art algorithms and pipelines10.1186/s12859-023-05486-8 ↗
52. A high-throughput imaging and nuclear segmentation analysis protocol for cleared 3D culture models10.1038/s41598-018-29169-0 ↗
53. Karimi · Intelligent computing applications for COVID-19 · 2021 · 23510.1201/9781003141105-12 ↗
54. Mask R-CNN
55. End-to-end deep learning-based cells detection in microscopic leucorrhea images10.1017/S1431927622000265 ↗
56. Automatic patient-level recognition of four Plasmodium species on thin blood smear by a real-time detection transformer (RT-DETR) object detection algorithm: a proof-of-concept and evaluation10.1128/spectrum.01440-23 ↗
57. Masked-attention mask transformer for universal image segmentation
58. Apply masked-attention mask transformer to instance segmentation in pathology images
59. Phoommanee · Medical imaging 2024: computer-aided diagnosis · 2024
60. A model of saliency-based visual attention for rapid scene analysis10.1109/34.730558 ↗
61. Leventhal AG. The neural basis of visual function; 1991 [cited 2025 Jun 16]. Available from: https://books.google.com/books?id=FaRTxgEACAAJ.
62. Ensemble-based multimodal medical imaging fusion for tumor segmentation10.1016/j.bspc.2024.106550 ↗
63. Deep learning-based skin lesion analysis using hybrid ResUNet++ and modified AlexNet-Random Forest for enhanced segmentation and classification10.1371/journal.pone.0315120 ↗
64. Noise resilience in dermoscopic image segmentation: comparing deep learning architectures for enhanced accuracy10.3390/electronics13173414 ↗
65. GP-GAN: brain tumor growth prediction using stacked 3D generative adversarial networks from longitudinal MR Images10.1016/j.neunet.2020.09.004 ↗
66. Improving tuberculosis severity assessment in computed tomography images using novel DAvoU-Net segmentation and deep learning framework10.1016/j.eswa.2022.119287 ↗
67. Microscopy cell nuclei segmentation with enhanced U-Net10.1186/s12859-019-3332-1 ↗
68. An accurate nuclei segmentation algorithm in pathological image based on deep semantic network10.1109/ACCESS.2019.2934486 ↗
69. Segmentation of patchy areas in biomedical images based on local edge density estimation10.1016/j.bspc.2022.104189 ↗
70. Mms-net: multi-level multi-scale feature extraction network for medical image segmentation10.1016/j.bspc.2023.105330 ↗
71. Multi-scale morphology-aided deep medical image segmentation10.1016/j.engappai.2024.109047 ↗
72. Multi-phase and multi-level selective feature fusion for automated pancreas segmentation from CT images
73. LiM-Net: lightweight multi-level multiscale network with deep residual learning for automatic liver segmentation in CT images10.1016/j.bspc.2022.104305 ↗
74. Automatic magnetic resonance prostate segmentation by deep learning with holistically nested networks10.1117/1.JMI.4.4.041302 ↗
75. Automatic segmentation of ovarian follicles using deep neural network combined with edge information10.3389/frph.2022.877216 ↗
76. BIF-Net: boundary information fusion network for abdominal aortic aneurysm segmentation10.1016/j.compbiomed.2024.109191 ↗
77. Early breast cancer prediction using thermal images and hybrid feature extraction based system10.1109/ACCESS.2025.3541051 ↗
78. Enhanced diagnosis of pes planus and pes cavus using deep learning-based segmentation of weight-bearing lateral foot radiographs: a comparative observer study10.1007/s13534-024-00439-3 ↗
79. A deep learning-based precision and automatic kidney segmentation system using efficient feature pyramid networks in computed tomography images10.1016/j.cmpb.2022.106854 ↗
80. RFPNet: reorganizing feature pyramid networks for medical image segmentation10.1016/j.compbiomed.2023.107108 ↗
81. Expressive feature representation pyramid network for pulmonary nodule detection10.1007/s00530-024-01532-4 ↗
82. HistoNeXt: dual-mechanism feature pyramid network for cell nuclear segmentation and classification10.1186/s12880-025-01550-2 ↗
83. Micro-KTNet: microstructure knowledge transfer learning for fiber masterbatch agglomeration recognition10.1177/15280837241307864 ↗
84. Bottom-up and top-down: bidirectional additive net for edge detection
85. FLPK-BiSeNet: federated learning based on priori knowledge and bilateral segmentation network for image edge extraction10.1109/TNSM.2023.3273991 ↗
86. FKAConv: feature-kernel alignment for point cloud convolution
87. Diagnosis of coronary heart disease through deep learning-based segmentation and localization in computed tomography angiography10.1109/ACCESS.2025.3528638 ↗
88. MPF-Net: a multi-scale feature learning network enhanced by prior knowledge integration for medical image segmentation10.1016/j.aej.2025.05.058 ↗
89. Artificial intelligence–aided selection of needle pathways: proof-of-concept in percutaneous lung biopsies10.1016/j.jvir.2023.11.016 ↗
90. Exploring the value of multiparametric quantitative magnetic resonance imaging in avoiding unnecessary biopsy in patients with PI-RADS 3–4
91. EFFResNet-ViT: a fusion-based convolutional and vision transformer model for explainable medical image classification10.1109/ACCESS.2025.3554184 ↗
92. DCSSGA-UNet: biomedical image segmentation with DenseNet channel spatial and Semantic Guidance Attention10.1016/j.knosys.2025.113233 ↗
93. Faster R-CNN: towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
94. Feature pyramid networks for object detection
95. Densely connected convolutional networks
96. DR-Unet: rethinking the ResUnet++ architecture with dual ResPath skip connection for Nuclei segmentation
97. A dense connection encoding–decoding convolutional neural network structure for semantic segmentation of thymoma10.1016/j.neucom.2021.04.023 ↗
98. MSF-TransUNet: a multi-scale fusion approach for precise cardiac image segmentation
99. RAU-Net: U-Net network based on residual multi-scale fusion and attention skip layer for overall spine segmentation10.1007/s00138-022-01360-4 ↗
100. Uncovering prototypical knowledge for weakly open-vocabulary semantic segmentation