Accelerated Edge-Aware Diffusion Model with Spatial Refinement for Clinical Medical Image Fusion
Source abstract
Abstract
Multimodal medical image fusion provides vital anatomical and pathological details for clinical diagnosis. However, existing diffusion algorithms often struggle with prolonged inference times and local structure loss. To address these critical issues in applied medical imaging, we propose an accelerated edge-aware diffusion model with spatial refinement. This framework utilizes a coarse-to-fine collaborative architecture. It first extracts structural priors via edge-enhanced data blocks and a non-uniform time-step accelerated sampling strategy. During refinement, a spatially adaptive non-convex variational module employs a Nesterov accelerated alternating direction method of multipliers for pixel-level correction to efficiently remove diffusion artifacts and sharpen anatomical boundaries. We conduct extensive comparative experiments against the vanilla diffusion baseline and state-of-the-art deep learning paradigms. Qualitative and quantitative evaluations on clinical datasets demonstrate the superior balanced performance of our model. The framework delivers highly natural visual representations, effectively merging sharp skeletal contours from computed tomography with rich soft tissue textures from magnetic resonance imaging while preventing unnatural over-sharpening. Additionally, it demonstrates outstanding performance across comprehensive statistical metrics, reflecting exceptional image fidelity, robust global contrast, and precise structural preservation. Furthermore, the model reduces inference time by approximately 42% compared to the baseline. Ultimately, this framework strikes an optimal balance between superior image fusion quality and computational efficiency, offering enhanced visual representations with potential utility for clinical image processing under limited resources.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Image Fusion Techniques · Advanced Image Processing Techniques · Image Enhancement Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mathematics and Physics, North China Electric Power University, Beijing 102206, China
Funding
Beijing Natural Science Foundation · Central University Fund · Natural Science Foundation of China
References (37)
Show source-provided references
1. An overview of multi-modal medical image fusion10.1016/j.neucom.2015.07.160 ↗
2. Multimodal Medical Image Fusion: Techniques, Databases, Evaluation Metrics, and Clinical Applications—A Comprehensive Review10.2174/0118744400417835251022042920 ↗
3. DiffRecon: Diffusion-based CT reconstruction with cross-modal deformable fusion for DR-guided non-coplanar radiotherapy10.1016/j.compbiomed.2024.108868 ↗
4. Multisensor Image Fusion Using the Wavelet Transform10.1006/gmip.1995.1022 ↗
5. Multi-focus image fusion with Geometrical Sparse Representation10.1016/j.image.2020.116130 ↗
6. Multi-focus image fusion with a deep convolutional neural network10.1016/j.inffus.2016.12.001 ↗
7. FusionGAN: A generative adversarial network for infrared and visible image fusion10.1016/j.inffus.2018.09.004 ↗
8. Image fusion meets deep learning: A survey and perspective10.1016/j.inffus.2021.06.008 ↗
9. Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M.F., and Lin, H. (2020). Denoising Diffusion Probabilistic Models. Advances in Neural Information Processing Systems, Curran Associates, Inc.
10. Zhao, Z., Bai, H., Zhu, Y., Zhang, J., Xu, S., Zhang, Y., Zhang, K., Meng, D., Timofte, R., and Van Gool, L. (2023, January 1–6). DDFM: Denoising Diffusion Model for Multi-Modality Image Fusion. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Paris, France.10.1109/ICCV51070.2023.00742 ↗
11. Xu, X., Cao, B., Li, D., Hu, Q., and Zhu, P. (2026). Reversible Efficient Diffusion for Image Fusion. arXiv.
12. Diffusion models in medical imaging: A comprehensive survey10.1016/j.media.2023.102846 ↗
13. An integrated index for identification of fatty liver disease using radon transform and discrete cosine transform features in ultrasound images10.1016/j.inffus.2015.12.007 ↗
14. Iterative Methods for Total Variation Denoising10.1137/0917016 ↗
15. On Iteratively Reweighted Algorithms for Nonsmooth Nonconvex Optimization in Computer Vision10.1137/140971518 ↗
16. Automated Regularization Parameter Selection in Multi-Scale Total Variation Models for Image Restoration10.1007/s10851-010-0248-9 ↗
17. Zhu, J., Chen, X., He, K., LeCun, Y., and Liu, Z. (2025, January 11–15). Transformers without Normalization. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR52734.2025.01388 ↗
18. DDPM-EMF: A denoising diffusion probabilistic model-based feature-enhancement fusion network for medical image fusion10.1364/JOSAA.549576 ↗
19. Image Fusion With Guided Filtering10.1109/TIP.2013.2244222 ↗
20. A Feasible Nonconvex Relaxation Approach to Feature Selection
21. de Bruijne, M., Cattin, P.C., Cotin, S., Padoy, N., Speidel, S., Zheng, Y., and Essert, C. (2021). Nesterov Accelerated ADMM for Fast Diffeomorphic Image Registration. Medical Image Computing and Computer Assisted Intervention—MICCAI 2021, Springer International Publishing.10.1007/978-3-030-87193-2 ↗
22. Fast-DDPM: Fast Denoising Diffusion Probabilistic Models for Medical Image-to-Image Generation10.1109/JBHI.2025.3565183 ↗
23. Zhang, X., Liang, J., Cao, P., Yang, J., and Zaiane, O.R. (2025). Structure-Aware MRI Translation: Multi-Modal Latent Diffusion Model with Arbitrary Missing Modalities. Proceedings of Medical Image Computing and Computer Assisted Intervention—MICCAI 2025, Springer.10.1007/978-3-032-04984-1_49 ↗
24. Kim, J., and Park, H. (2024, January 4–8). Adaptive Latent Diffusion Model for 3D Medical Image to Image Translation: Multi-modal Magnetic Resonance Imaging Study. Proceedings of the 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.10.1109/WACV57701.2024.00743 ↗
25. Gee, J.C., Alexander, D.C., Hong, J., Iglesias, J.E., Sudre, C.H., Venkataraman, A., Golland, P., Kim, J.H., and Park, J. (2026). Lesion-Aware Post-training of Latent Diffusion Models for Synthesizing Diffusion MRI from CT Perfusion. Medical Image Computing and Computer Assisted Intervention—MICCAI 2025, Springer.
26. Azad, M., Fahad, N.M., Raiaan, M.A.K., Anik, T.R., Khan, M.F.K., Toyé, H.M.K., and Muhammad, G. (2026). A Systematic Review of Diffusion Models for Medical Image-Based Diagnosis: Methods, Taxonomies, Clinical Integration, Explainability, and Future Directions. Diagnostics, 16.10.3390/diagnostics16020211 ↗
27. Nonconvex-TV Based Image Restoration with Impulse Noise Removal10.1137/16M1076034 ↗
28. Scope of validity of PSNR in image/video quality assessment10.1049/el:20080522 ↗
29. Infrared and visible image fusion methods and applications: A survey10.1016/j.inffus.2018.02.004 ↗
30. Image quality measures and their performance10.1109/26.477498 ↗
31. Information measure for performance of image fusion10.1049/el:20020212 ↗
32. Piella, G., and Heijmans, H. (2003, January 14–18). A new quality metric for image fusion. Proceedings of the 2003 International Conference on Image Processing, Barcelona, Spain.
33. Objective image fusion performance measure10.1049/el:20000267 ↗
34. IFCNN: A general image fusion framework based on convolutional neural network10.1016/j.inffus.2019.07.011 ↗
35. U2Fusion: A Unified Unsupervised Image Fusion Network10.1109/TPAMI.2020.3012548 ↗
36. Zhao, Z., Bai, H., Zhang, J., Zhang, Y., Xu, S., Lin, Z., Timofte, R., and Van Gool, L. (2023, January 17–24). CDDFuse: Correlation-driven dual-branch feature decomposition for multi-modality image fusion. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.00572 ↗
37. LFDT-Fusion: A latent feature-guided diffusion Transformer model for general image fusion10.1016/j.inffus.2024.102639 ↗