A Query-Based Progressive Aggregation Network for 3D Medical Image Segmentation
Source abstract
Abstract
Accurate 3D medical image segmentation is crucial for knowledge-driven clinical decision-making and computer-aided diagnosis. However, current deep learning methods often fail to effectively integrate local structural details from Convolutional Neural Networks (CNNs) with global semantic context from Transformers due to semantic inconsistency and poor cross-scale feature alignment. To address this, Progressive Query Aggregation Network (PQAN), a novel framework that incorporates knowledge-guided feature interaction mechanisms, is proposed. PQAN employs two complementary query modules: Structural Feature Query, which uses anatomical morphology for boundary-aware representation, and Content Feature Query, which enhances semantic alignment between encoding and decoding stages. To enhance texture perception, a Texture Attention (TA) module based on Sobel operators adds directional edge awareness and fine-detail enhancement. Moreover, a Progressive Aggregation Strategy with Forward and Backward Cross-Stage Attention gradually aligns and refines multi-scale features, thereby reducing semantic deviations during CNN-Transformer fusion. Experiments on public benchmarks demonstrate that PQAN outperforms state-of-the-art models in both global accuracy and boundary segmentation. On the BTCV and FLARE datasets, PQAN had average Dice scores of 0.926 and 0.816, respectively. These results demonstrate PQAN’s ability to capture complex anatomical structures, small targets, and ambiguous organ boundaries, resulting in an interpretable and scalable solution for real-world clinical deployment.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Medical Imaging and Analysis · AI in cancer detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mechanical and Automotive Engineering, South China University of Technology, Guangzhou 510640, China
School of Aeronautical Manufacturing and Mechanical Engineering, Nanchang Hangkong University, Nanchang 330063, China
References (60)
Show source-provided references
1. TPFIANet: Three path feature progressive interactive attention learning network for medical image segmentation10.1016/j.knosys.2025.113778 ↗
2. Deep learning for medical image segmentation: State-of-the-art advancements and challenges10.1016/j.imu.2024.101504 ↗
3. Medical image segmentation review: The success of u-net10.1109/TPAMI.2024.3435571 ↗
4. CSCA U-Net: A channel and space compound attention CNN for medical image segmentation10.1016/j.artmed.2024.102800 ↗
5. HA-U3Net: A Modality-Agnostic Framework for 3D Medical Image Segmentation Using Nested V-Net Structure and Hybrid Attention10.1016/j.knosys.2025.114127 ↗
6. TransUNet: Rethinking the U-Net architecture design for medical image segmentation through the lens of transformers10.1016/j.media.2024.103280 ↗
7. EDGE: Edge distillation and gap elimination for heterogeneous networks in 3D medical image segmentation10.1016/j.knosys.2025.113234 ↗
8. Xing, Z., Ye, T., Yang, Y., Liu, G., and Zhu, L. (2024, January 6–10). Segmamba: Long-range sequential modeling mamba for 3d medical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Marrakesh, Morocco.10.1007/978-3-031-72111-3_54 ↗
9. Ma-sam: Modality-agnostic sam adaptation for 3d medical image segmentation10.1016/j.media.2024.103310 ↗
10. Isensee, F., Wald, T., Ulrich, C., Baumgartner, M., Roy, S., Maier-Hein, K., and Jaeger, P.F. (2024, January 6–10). nnu-net revisited: A call for rigorous validation in 3d medical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Marrakesh, Morocco.10.1007/978-3-031-72114-4_47 ↗
11. Saifullah, S., and Dreżewski, R. (2024, January 2–4). Enhancing breast cancer diagnosis: A CNN-based approach for medical image segmentation and classification. Proceedings of the International Conference on Computational Science, Malaga, Spain.10.1007/978-3-031-63772-8_15 ↗
12. Medical image segmentation using grey wolf-based u-net with bi-directional convolutional LSTM10.1142/S0218001423540253 ↗
13. HTC-Net: A hybrid CNN-transformer framework for medical image segmentation10.1016/j.bspc.2023.105605 ↗
14. UCTNet: Uncertainty-guided CNN-Transformer hybrid networks for medical image segmentation10.1016/j.patcog.2024.110491 ↗
15. Lan, L., Cai, P., Jiang, L., Liu, X., Li, Y., and Zhang, Y. (2024). Brau-net++: U-shaped hybrid cnn-transformer network for medical image segmentation. arXiv.
16. MS-TCNet: An effective Transformer–CNN combined network using multi-scale feature learning for 3D medical image segmentation10.1016/j.compbiomed.2024.108057 ↗
17. HmsU-Net: A hybrid multi-scale U-net based on a CNN and transformer for medical image segmentation10.1016/j.compbiomed.2024.108013 ↗
18. Wang, X., Girshick, R., Gupta, A., and He, K. (2018, January 18–23). Non-local neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00813 ↗
19. Hu, J., Chen, S., Pan, Z., Zeng, S., and Yang, W. (2024, January 6–10). Perspective+ Unet: Enhancing Segmentation with Bi-Path Fusion and Efficient Non-Local Attention for Superior Receptive Fields. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Marrakesh, Morocco.10.1007/978-3-031-72114-4_48 ↗
20. Combining external-latent attention for medical image segmentation10.1016/j.neunet.2023.10.046 ↗
21. Medical Images Enhancement by Integrating CLAHE with Wavelet Transform and Non-Local Means Denoising
22. SwinVNETR: Swin V-net Transformer with non-local block for volumetric MRI Brain Tumor Segmentation
23. Zhan, S., Yuan, Q., Lei, X., Huang, R., Guo, L., Liu, K., and Chen, R. (2024). BFNet: A full-encoder skip connect way for medical image segmentation. Front. Physiol., 15.10.3389/fphys.2024.1412985 ↗
24. Perera, S., Navard, P., and Yilmaz, A. (2024, January 16–22). Segformer3d: An efficient transformer for 3d medical image segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPRW63382.2024.00503 ↗
25. SSTrans-Net: Smart Swin Transformer Network for medical image segmentation10.1016/j.bspc.2024.106071 ↗
26. CSWin-UNet: Transformer UNet with cross-shaped windows for medical image segmentation10.1016/j.inffus.2024.102634 ↗
27. Wu, J., Ji, W., Fu, H., Xu, M., Jin, Y., and Xu, Y. (March, January 25). Medsegdiff-v2: Diffusion-based medical image segmentation with transformer. Proceedings of the AAAI Conference on Artificial Intelligence, Philadelphia, PA, USA.
28. CFNet: Cross-scale fusion network for medical image segmentation10.1016/j.jksuci.2024.102123 ↗
29. Cross-scale informative priors network for medical image segmentation10.1016/j.dsp.2024.104883 ↗
30. Dai, W., Wu, Z., Liu, R., Zhou, J., Wang, M., Wu, T., and Liu, J. (2024, January 27–30). Sosegformer: A Cross-Scale Feature Correlated Network For Small Medical Object Segmentation. Proceedings of the 2024 IEEE International Symposium on Biomedical Imaging (ISBI), Athens, Greece.10.1109/ISBI56570.2024.10635300 ↗
31. CRMEFNet: A coupled refinement, multiscale exploration and fusion network for medical image segmentation10.1016/j.compbiomed.2024.108202 ↗
32. CasUNeXt: A Cascaded Transformer With Intra-and Inter-Scale Information for Medical Image Segmentation10.1002/ima.23184 ↗
33. Kervadec, H., Bouchtiba, J., Desrosiers, C., Granger, E., Dolz, J., and Ben Ayed, I. (2019, January 8–10). Boundary loss for highly unbalanced segmentation. Proceedings of the International Conference on Medical Imaging with Deep Learning, London, UK.
34. Milletari, F., Navab, N., and Ahmadi, S.-A. (2016, January 25–28). “V-net: Fully convolutional neural networks for volumetric medical image segmentation”. Proceedings of the 2016 Fourth International Conference on 3D Vision (3DV), Stanford, CA, USA.10.1109/3DV.2016.79 ↗
35. Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press.
36. Landman, B., Xu, Z., Igelsias, J., Styner, M., Langerak, T., and Klein, A. (2025, December 05). Multi-Atlas Labeling Beyond the Cranial Vault. Available online: https://www.synapse.org.
37. Ma, J., Zhang, Y., Gu, S., Ge, C., Wang, E., Zhou, Q., Huang, Z., Lyu, P., He, J., and Wang, B. (2024). Automatic organ and pan-cancer segmentation in abdomen ct: The flare 2023 challenge. arXiv.
38. Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., and Torr, P.H.S. (2021, January 20–25). Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00681 ↗
39. nnU-Net: A self-configuring method for deep learning-based biomedical image segmentation10.1038/s41592-020-01008-z ↗
40. Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8–14). Encoder-decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_49 ↗
41. Caron, M., Touvron, H., Misra, I., Jégou, H., Mairal, J., Bojanowski, P., and Joulin, A. (2021, January 10–17). Emerging properties in self-supervised vision transformers. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00951 ↗
42. Xie, Y., Zhang, J., Shen, C., and Xia, Y. (October, January 27). Cotr: Efficiently bridging cnn and transformer for 3d medical image segmentation. Proceedings of the Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France.10.1007/978-3-030-87199-4_16 ↗
43. High-resolution 3D abdominal segmentation with random patch network fusion10.1016/j.media.2020.101894 ↗
44. Multi-organ Segmentation from Partially Labeled and Unaligned Multi-modal MRI in Thyroid-associated Orbitopathy10.1109/JBHI.2025.3545138 ↗
45. A-Eval: A benchmark for cross-dataset and cross-modality evaluation of abdominal multi-organ segmentation10.1016/j.media.2025.103499 ↗
46. Gillot, M., Baquero, B., Le, C., Deleat-Besson, R., Bianchi, J., Ruellas, A., Gurgel, M., Yatabe, M., Al Turkestani, N., and Najarian, K. (2022). Automatic multi-anatomical skull structure segmentation of cone-beam computed tomography scans using 3D UNETR. PLoS ONE, 17.10.1371/journal.pone.0275033 ↗
47. Decoupled pixel-wise correction for abdominal multi-organ segmentation10.1007/s40747-025-01796-x ↗
48. Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., and Sutskever, I. (2021, January 18–24). Learning transferable visual models from natural language supervision. Proceedings of the International Conference on Machine Learning, Virtual.
49. Rao, Y., Zhao, W., Chen, G., Tang, Y., Zhu, Z., Huang, G., Zhou, J., and Lu, J. (2022, January 18–24). Denseclip: Language-guided dense prediction with context-aware prompting. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01755 ↗
50. Eslami, S., de Melo, G., and Meinel, C. (2021). Does clip benefit visual question answering in the medical domain as much as it does in the general domain?. arXiv.
51. MOSMOS: Multi-organ segmentation facilitated by medical report supervision10.1016/j.bspc.2025.107743 ↗
52. Springenberg, J.T. (2015). Unsupervised and semi-supervised learning with categorical generative adversarial networks. arXiv.
53. Tarvainen, A., and Valpola, H. (2017). Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results. arXiv.
54. Yu, L., Wang, S., Li, X., Fu, C.W., and Heng, P.A. (2019, January 13–17). Uncertainty-aware self-ensembling model for semi-supervised 3D left atrium segmentation. Proceedings of the Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China.10.1007/978-3-030-32245-8_67 ↗
55. Interpolation consistency training for semi-supervised learning10.1016/j.neunet.2021.10.008 ↗
56. Semi-supervised medical image segmentation via uncertainty rectified pyramid consistency10.1016/j.media.2022.102517 ↗
57. Chen, Y., Yang, Z., Shen, C., Wang, Z., Qin, Y., and Zhang, Y. (2023, January 18–21). EVIL: Evidential inference learning for trustworthy semi-supervised medical image segmentation. Proceedings of the 2023 IEEE 20th International Symposium on Biomedical Imaging (ISBI), Cartagena, Colombia.10.1109/ISBI53787.2023.10230589 ↗
58. Feng, Z., Wen, L., Xu, Y., Yan, B., Wu, X., Zhou, J., and Wang, Y. (2025). BASIC: Semi-supervised Multi-organ Segmentation with Balanced Subclass Regularization and Semantic-conflict Penalty. arXiv.10.1109/LSP.2024.3451962 ↗
59. Wang, S., Safari, M., Li, Q., Chang, C.W., Qiu, R.L., Roper, J., Yu, D.S., and Yang, X. (2025). Triad: Vision Foundation Model for 3D Magnetic Resonance Imaging. arXiv.10.21203/rs.3.rs-6129856/v1 ↗
60. An efficient segment anything model for the segmentation of medical images10.1038/s41598-024-70288-8 ↗