SwinIR-based Dual-Domain Reconstruction for Sparse-View Computed Tomography
Source abstract
Abstract
Sparse-view computed tomography (CT) remains a significant challenge due to undersampling artifacts and loss of structural detail in the reconstructed images. In this work, we introduce DDSwinIR, a dual-domain reconstruction framework that leverages Swin Transformer-based architectures to recover high-quality CT images from severely undersampled sinograms. DDSwinIR operates in three stages: sinogram upsampling, deep learning-based reconstruction, and a residual refinement module that addresses domain-specific inconsistencies. While previous dual-domain deep learning (DD-DL) approaches improve reconstruction quality, they lack a systematic analysis of component contributions and do not generalize to unseen number of projections. DDSwinIR addresses these gaps through a modular and transparent design, allowing quantification of each network’s module. Our results highlight that early application of data consistency, especially after initial sinogram reconstruction, yields the most substantial and reliable improvements, particularly under extreme sparsity. We also introduce sparse-view concatenation, which enhances performance by improving feature propagation in highly undersampled settings. Extensive evaluation across varying numbers of projections reveal strong generalization when trained on sparse data and tested on denser configurations, but not vice versa, underscoring the importance of low-sparsity training. Compared to conventional reconstruction methods, DDSwinIR achieves superior artifact suppression and detail preservation. This work establishes DDSwinIR as an interpretable and generalizable solution for sparse-view CT, responding to the need for DD-DL reconstruction frameworks for practical applicability.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Medical Imaging Techniques and Applications · Advanced X-ray and CT Imaging · Advanced MRI Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (45)
Show source-provided references
1. Brenner, D.J., Hall, E.J.: Computed tomography-An increasing source of radiation exposure. N. Engl. J. Med. 357(22), 2277–2284 (2007)10.1056/NEJMra072149 ↗
2. Di, J., Lin, J., Zhong, L., Qian, K., Qin, Y.: Review of sparse-view or limited-angle CT reconstruction based on deep learning. Laser & Optoelectronics Progress 60(8), 0811002 (2023)10.3788/LOP230488 ↗
3. Kalke, M., Siltanen, S.: Sinogram interpolation method for sparse-angle tomography. Appl. Math. 5(3), 423–441 (2014)10.4236/am.2014.53043 ↗
4. Kim, H.-G., Yoo, H.: Image enhancement for computed tomography using directional interpolation for sparsely-sampled sinogram. Optik 166, 227–235 (2018)10.1016/j.ijleo.2018.03.139 ↗
5. Van Gompel, G., Defrise, M., Van Dyck, D.: Elliptical extrapolation of truncated 2D CT projections using Helgason-Ludwig consistency conditions. In: Medical Imaging 2006: Physics of Medical Imaging, vol. 6142, pp. 1408–1417 (2006)10.1117/12.653293 ↗
6. Geraldo, R.J., Cura, L.M., Cruvinel, P.E., Mascarenhas, N.D.: Low dose CT filtering in the image domain using MAP algorithms. IEEE Trans. Rad. Plasma Med. Sci. 1(1), 56–67 (2016)10.1109/TNS.2016.2635131 ↗
7. Zeng, G.L.: An attempt of directly filtering the sparse-view CT images by BM3D. In: 7th International Conference on Image Formation in X-Ray Computed Tomography, vol. 12304, pp. 568–575 (2022)10.1117/12.2646426 ↗
8. Trampert, J., Leveque, J.-J.: Simultaneous iterative reconstruction technique: Physical interpretation based on the generalized least squares solution. J. Geophys. Res. Solid Earth 95(B8), 12553–12559 (1990)10.1029/JB095iB08p12553 ↗
9. Huang, K., Gao, Z., Yang, F., Zhang, H., Zhang, D.: An improved discrete algebraic reconstruction technique for limited-view based on gray mean value guidance. J. Nondestr. Eval. 42(1), 6 (2023)10.1007/s10921-022-00916-8 ↗
10. Lv, L., Li, C., Wei, W., Sun, S., Ren, X., Pan, X., Li, G.: Optimization of sparse-view CT reconstruction based on convolutional neural network. Med. Phys. 52(4), 2089–2105 (2025)10.1002/mp.17636 ↗
11. Lee, M., Kim, H., Kim, H.-J.: Sparse-view CT reconstruction based on multi-level wavelet convolution neural network. Physica Med. 80, 352–362 (2020)10.1016/j.ejmp.2020.11.021 ↗
12. Ulyanov, D., Vedaldi, A., Lempitsky, V.: Deep image prior. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 9446–9454 (2018)10.1109/CVPR.2018.00984 ↗
13. Baguer, D.O., Leuschner, J., Schmidt, M.: Computed tomography reconstruction using deep image prior and learned reconstruction methods. Inverse Prob. 36(9), 094004 (2020)10.1088/1361-6420/aba415 ↗
14. Shu, Z., Entezari, A.: Sparse-view and limited-angle CT reconstruction with untrained networks and deep image prior. Comput. Methods Programs Biomed. 226, 107167 (2022)10.1016/j.cmpb.2022.107167 ↗
15. Bossuyt, C., De Beenhouwer, J., Sijbers, J., Iuso, D., Costin, M., Escoda, J., Le Hoang, T.V., Dekker, A.J.: Deep image prior for sparse-view reconstruction in static, rectangular multi-source X-ray CT systems for cargo scanning. In: Developments in X-Ray Tomography XV, vol. 13152, p. 131520 (2024). SPIE10.1117/12.3027668 ↗
16. Shu, Z., Pan, Z.: SDIP: Self-reinforcement deep image prior framework for image processing (2024). arXiv preprint arXiv:2404.1214210.1016/j.patcog.2025.111786 ↗
17. Shu, Z., Entezari, A.: RBP-DIP: Residual back projection with deep image prior for ill-posed CT reconstruction. Neural Netw. 180, 106740 (2024)10.1016/j.neunet.2024.106740 ↗
18. Ronneberger, O., Fischer, P., Brox, T.: U-Net: Convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, pp. 234–241 (2015). Springer10.1007/978-3-319-24574-4_28 ↗
19. Han, Y., Ye, J.C.: Framing U-Net via deep convolutional framelets: Application to sparse-view CT. IEEE Trans. Med. Imaging 37(6), 1418–1429 (2018)10.1109/TMI.2018.2823768 ↗
20. Liu, P., Zhang, H., Lian, W., Zuo, W.: Multi-level wavelet convolutional neural networks. IEEE Access 7, 74973–74985 (2019)10.1109/ACCESS.2019.2921451 ↗
21. Gupta, H., Jin, K.H., Nguyen, H.Q., McCann, M.T., Unser, M.: CNN-based projected gradient descent for consistent CT image reconstruction. IEEE Trans. Med. Imaging 37(6), 1440–1453 (2018)10.1109/TMI.2018.2832656 ↗
22. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al.: An image is worth 16x16 words: Transformers for image recognition at scale (2020). arXiv preprint arXiv:2010.11929
23. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., Polosukhin, I.: Attention is all you need. Adv. Neural Inform. Process. Syst. 30 (2017)
24. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., Guo, B.: Swin transformer: Hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 10012–10022 (2021)10.1109/ICCV48922.2021.00986 ↗
25. Zhang, Z., Liang, X., Dong, X., Xie, Y., Cao, G.: A sparse-view CT reconstruction method based on combination of DenseNet and deconvolution. IEEE Trans. Med. Imaging 37(6), 1407–1417 (2018)10.1109/TMI.2018.2823338 ↗
26. Li, Z., Cai, A., Wang, L., Zhang, W., Tang, C., Li, L., Liang, N., Yan, B.: Promising generative adversarial network based sinogram inpainting method for ultra-limited-angle computed tomography imaging. Sensors 19(18), 3941 (2019)10.3390/s19183941 ↗
27. Dong, X., Vekhande, S., Cao, G.: Sinogram interpolation for sparse-view micro-CT with deep learning neural network. In: Medical Imaging 2019: Physics of Medical Imaging, vol. 10948, pp. 692–698 (2019)
28. Guan, B., Yang, C., Zhang, L., Niu, S., Zhang, M., Wang, Y., Wu, W., Liu, Q.: Generative modeling in sinogram domain for sparse-view CT reconstruction. IEEE Trans. Rad. Plasma Med. Sci. 8(2), 195–207 (2023)10.1109/TRPMS.2023.3309474 ↗
29. Kuo, C., Wei, T.-T., Chen, J.-J., Tseng, Y.-C.: Circular LSTM for low-dose sinograms inpainting. IEEE Access 11, 78480–78488 (2023)10.1109/ACCESS.2023.3295246 ↗
30. Lee, D., Choi, S., Kim, H.-J.: High quality imaging from sparsely sampled computed tomography data with deep learning and wavelet transform in various domains. Med. Phys. 46(1), 104–115 (2019)10.1002/mp.13258 ↗
31. Wang, C., Shang, K., Zhang, H., Li, Q., Zhou, S.K.: DuDoTrans: dual-domain transformer for sparse-view CT reconstruction. In: International Workshop on Machine Learning for Medical Image Reconstruction, pp. 84–94 (2022)10.1007/978-3-031-17247-2_9 ↗
32. Yuan, H., Jia, J., Zhu, Z.: Sipid: A deep learning framework for sinogram interpolation and image denoising in low-dose CT reconstruction. In: 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp. 1521–1524 (2018)10.1109/ISBI.2018.8363862 ↗
33. Yang, C., Sheng, D., Yang, B., Zheng, W., Liu, C.: A dual-domain diffusion model for sparse-view CT reconstruction. IEEE Signal Process. Lett. (2024)10.36227/techrxiv.23726703.v2 ↗
34. Pan, J., Zhang, H., Wu, W., Gao, Z., Wu, W.: Multi-domain integrative Swin transformer network for sparse-view tomographic reconstruction. Patterns 3(6) (2022)10.1016/j.patter.2022.100498 ↗
35. Wu, W., Hu, D., Niu, C., Yu, H., Vardhanabhuti, V., Wang, G.: Drone: Dual-domain residual-based optimization network for sparse-view CT reconstruction. IEEE Trans. Med. Imaging 40(11), 3002–3014 (2021)10.1109/TMI.2021.3078067 ↗
36. Li, Y., Sun, X., Wang, S., Li, X., Qin, Y., Pan, J., Chen, P.: MDST: multi-domain sparse-view CT reconstruction based on convolution and swin transformer. Phys. Med. Biol. 68(9), 095019 (2023)10.1088/1361-6560/acc2ab ↗
37. Van der Rauwelaert, J., Bossuyt, C., Sijbers, J.: Dual domain Swin transformer based reconstruction method for sparse-view computed tomography. e-Journal of Nondestructive Testing 30(2) (2025). Presented at the 14th Conference on Industrial Computed Tomography (iCT), 4–7 February 2025, Antwerp, Belgium10.58286/30751 ↗
38. Liang, J., Cao, J., Sun, G., Zhang, K., Van Gool, L., Timofte, R.: SwinIR: Image restoration using swin transformer. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 1833–1844 (2021)10.1109/ICCVW54120.2021.00210 ↗
39. Brody, S., Alon, U., Yahav, E.: On the expressivity role of LayerNorm in transformers’ attention. arXiv preprint arXiv:2305.02582 (2023)10.18653/v1/2023.findings-acl.895 ↗
40. Feldkamp, L.A., Davis, L.C., Kress, J.W.: Practical cone-beam algorithm. J. Opt. Soc. Am. A 1(6), 612–619 (1984)10.1364/JOSAA.1.000612 ↗
41. Van Aarle, W., Palenstijn, W.J., Cant, J., Janssens, E., Bleichrodt, F., Dabravolski, A., De Beenhouwer, J., Batenburg, K.J., Sijbers, J.: Fast and flexible X-ray tomography using the ASTRA toolbox. Opt. Express 24(22), 25129–25147 (2016)10.1364/OE.24.025129 ↗
42. McCollough, C.: 2016 low-dose CT grand challenge (2022). https://doi.org/10.21227/4yqw-236410.21227/4yqw-2364 ↗
43. Kingma, D., Ba, J.: Adam: A method for stochastic optimization. In: International Conference on Learning Representations, San Diego, USA (2015)
44. Cao, N., Li, Q., Sun, K., Zhang, H., Ding, J., Wang, Z., Chen, W., Gao, L., Sun, J., Xie, K., Ni, X.: MBST-driven 4D-CBCT reconstruction: Leveraging Swin transformer and masking for robust performance. Comput. Methods Programs Biomed. 108637 (2025)10.1016/j.cmpb.2025.108637 ↗
45. Tang, Y., Yang, D., Li, W., Roth, H.R., Landman, B., Xu, D., Nath, V., Hatamizadeh, A.: Self-supervised pre-training of Swin transformers for 3D medical image analysis. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 20730–20740 (2022)10.1109/CVPR52688.2022.02007 ↗