journal article·2023Open access

A Novel Unsupervised MRI Synthetic CT Image Generation Framework with Registration Network

Liwei Deng, Henan Sun, Jing Wang, Sijuan Huang, Xin Yang

Computers, Materials & Continua· Volume 77· Issue 2

Abstract

In recent years, radiotherapy based only on Magnetic Resonance (MR) images has become a hot spot for radiotherapy planning research in the current medical field. However, functional computed tomography (CT) is still needed for dose calculation in the clinic. Recent deep-learning approaches to synthesized CT images from MR images have raised much research interest, making radiotherapy based only on MR images possible. In this paper, we proposed a novel unsupervised image synthesis framework with registration networks. This paper aims to enforce the constraints between the reconstructed image and the input image by registering the reconstructed image with the input image and registering the cycle-consistent image with the input image. Furthermore, this paper added ConvNeXt blocks to the network and used large kernel convolutional layers to improve the network’s ability to extract features. This research used the collected head and neck data of 180 patients with nasopharyngeal carcinoma to experiment and evaluate the training model with four evaluation metrics. At the same time, this research made a quantitative comparison of several commonly used model frameworks. We evaluate the model performance in four evaluation metrics which achieve Mean Absolute Error (MAE), Root Mean Square Error (RMSE), Peak Signal-to-Noise Ratio (PSNR), and Structural Similarity (SSIM) are 18.55 ± 1.44, 86.91 ± 4.31, 33.45 ± 0.74 and 0.960 ± 0.005, respectively. Compared with other methods, MAE decreased by 2.17, RMSE decreased by 7.82, PSNR increased by 0.76, and SSIM increased by 0.011. The results show that the model proposed in this paper outperforms other methods in the quality of image synthesis. The work in this paper is of guiding significance to the study of MR-only radiotherapy planning.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Radiotherapy Techniques · Radiomics and Machine Learning in Medical Imaging · Medical Imaging Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (31)

Show source-provided references
1. The calibration of CT Hounsfield units for radiotherapy treatment planning10.1088/0031-9155/41/1/009 ↗
2. Imaging of soft-tissue myxoma with emphasis on CT and MR and comparison of radiologic and pathologic findings10.1148/radiol.2251011627 ↗
3. Radiotherapy planning using MRI10.1088/0031-9155/60/22/R323 ↗
4. Dedicated magnetic resonance imaging in the radiotherapy clinic10.1016/j.ijrobp.2009.01.065 ↗
5. MRI-only based radiation therapy of prostate cancer: Workflow and early clinical experience10.1080/0284186X.2018.1445284 ↗
6. A review of substitute CT generation for MRI-only radiation therapy10.1186/s13014-016-0747-y ↗
7. Comparative study of algorithms for synthetic CT generation from MRI: Consequences for MRI-guided radiation planning in the pelvic region10.1002/mp.13187 ↗
8. Systematic review of synthetic computed tomography generation methodologies for use in magnetic resonance imaging-only radiation therapy10.1016/j.ijrobp.2017.08.043 ↗
9. Magnetic resonance-based automatic air segmentation for generation of synthetic computed tomography scans in the head region10.1016/j.ijrobp.2015.07.001 ↗
10. A patch-based pseudo-CT approach for MRI-only radiotherapy in the pelvis10.1118/1.4958676 ↗
11. Direct pseudoCT generation for pelvis PET/MRI attenuation correction using deep convolutional neural networks with multi-parametric MRI: Zero echo-time and Dixon deep pseudoCT (ZeDD-CT)
12. MRI-only brain radiotherapy: Assessing the dosimetric accuracy of synthetic CT images generated using a deep learning approach10.1016/j.radonc.2019.03.026 ↗
13. Comparison of deep learning-based and patch-based methods for pseudo-CT generation in MRI-based prostate dose planning10.1016/j.ijrobp.2019.08.049 ↗
14. Image synthesis in multi-contrast MRI with conditional generative adversarial networks10.1109/TMI.2019.2901750 ↗
15. Medical image synthesis with deep convolutional adversarial networks10.1109/TBME.2018.2814538 ↗
16. Unpaired image-to-image translation using cycle-consistent adversarial networks
17. Deep MR to CT synthesis using unpaired data
18. Unpaired deep cross-modality synthesis with fast training
19. Unsupervised MR-to-CT synthesis using structure-constrained CycleGAN10.1109/TMI.2020.3015379 ↗
20. D. P. Kingma and M. Welling, “Auto-encoding variational bayes,” arXiv:1312.6114, 2013.
21. Autoencoding beyond pixels using a learned similarity metric
22. Unsupervised image-to-image translation networks
23. Generative adversarial networks10.1145/3422622 ↗
24. A convnet for the 2020s
25. A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai et al., “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv:2010.11929, 2020.
26. Swin transformer: Hierarchical vision transformer using shifted windows
27. Deep residual learning for image recognition
28. Image-to-image translation with conditional adversarial networks
29. Breaking the dilemma of medical image-to-image translation
30. Multimodal unsupervised image-to-image translation
31. Hiplot: A comprehensive and easy-to-use web service for boosting publication-ready biomedical data visualization10.1093/bib/bbac261 ↗