Nonlinear Registration of Brain Magnetic Resonance Images with Cross Constraints of Intensity and Structure
Source abstract
Abstract
Many deep learning-based registration methods rely on a single-stream encoder-decoder network for computing deformation fields between 3D volumes. However, these methods often lack constraint information and overlook semantic consistency, limiting their performance. To address these issues, we present a novel approach for medical image registration called the Dual-VoxelMorph, featuring a dual-channel cross-constraint network. This innovative network utilizes both intensity and segmentation images, which share identical semantic information and feature representations. Two encoder-decoder structures calculate deformation fields for intensity and segmentation images, as generated by the dual-channel cross-constraint network. This design facilitates bidirectional communication between grayscale and segmentation information, enabling the model to better learn the corresponding grayscale and segmentation details of the same anatomical structures. To ensure semantic and directional consistency, we introduce constraints and apply the cosine similarity function to enhance semantic consistency. Evaluation on four public datasets demonstrates superior performance compared to the baseline method, achieving Dice scores of 79.9%, 64.5%, 69.9%, and 63.5% for OASIS-1, OASIS-3, LPBA40, and ADNI, respectively.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Medical Image Segmentation Techniques · Advanced MRI Techniques and Applications · Brain Tumor Detection and Classification
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (38)
Show source-provided references
1. Unsupervised learning for fast probabilistic diffeomorphic registration
2. Deep learning in medical image registration: A review10.1088/1361-6560/ab843e ↗
3. 3D deep learning on medical images: A review10.3390/s20185097 ↗
4. Registration methods for surgical navigation of the mandible: A systematic review10.1016/j.ijom.2022.01.017 ↗
5. Automated machine learning (AutoML)-based surface registration methodology for image-guided surgical navigation system10.1002/mp.15696 ↗
6. T. C. W. Mok and A. C. S. Chung, “Unsupervised deformable image registration with absent correspondences in pre-operative and post-recurrence brain tumor MRI scans,” 2022. doi: 10.48550/arXiv.2206.03900.
7. Computer-aided diagnosis of cirrhosis and hepatocellular carcinoma using multi-phase abdomen CT10.1007/s11548-019-01991-5 ↗
8. D. Wei et al., “An auto-context deformable registration network for infant brain MRI,” 2020. doi: 10.48550/arXiv.2005.09230.
9. Wei · Machine Learning in Medical Imaging · 2016 · 3610.1007/978-3-319-47157-0_5 ↗
10. Learning-based deformable registration for infant MRI by integrating random forest with auto-context model10.1002/mp.12578 ↗
11. Diffeomorphic demons: Efficient non-parametric image registration10.1016/j.neuroimage.2008.10.040 ↗
12. Large deformation diffeomorphic metric curve mapping10.1007/s11263-008-0141-9 ↗
13. Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain10.1016/j.media.2007.06.004 ↗
14. VoxelMorph: A learning framework for deformable medical image registration10.1109/TMI.2019.2897538 ↗
15. J. Zhang, “Inverse-consistent deep networks for unsupervised deformable image registration,” 2018. doi: 10.48550/arXiv.1809.03443.
16. Fast symmetric diffeomorphic image registration with convolutional neural networks
17. B. Kim, D. H. Kim, S. H. Park, J. Kim, J. G. Lee and J. C. Ye, “CycleMorph: Cycle consistent unsupervised deformable image registration,” 2020. doi: 10.48550/arXiv.2008.05772.10.1016/j.media.2021.102036 ↗
18. TransMorph: Transformer for unsupervised medical image registration10.1016/j.media.2022.102615 ↗
19. T. C. W. Mok and A. C. S. Chung, “Affine medical image registration with coarse-to-fine vision transformer,” 2022. doi: 10.48550/arXiv.2203.15216.
20. Zhu · Medical Image Computing and Computer Assisted Intervention—MICCAI 2022 · 2022 · 78
21. J. Shi et al., “XMorpher: Full transformer for deformable medical image registration via cross attention,” 2022. doi: 10.48550/arXiv.2206.07349.10.1007/978-3-031-16446-0_21 ↗
22. Adversarial deformation regularization for training image registration neural networks
23. X. Zhang, W. Jian, Y. Chen, and S. Yang, “Deform-GAN: An unsupervised learning model for deformable registration,” 2020. doi: 10.48550/arXiv.2002.11430.
24. SymReg-GAN: Symmetric image registration with generative adversarial networks
25. M. Kang, X. Hu, W. Huang, M. R. Scott, and M. Reyes, “Dual-stream pyramid registration network,” 2023. doi: 10.48550/arXiv.1909.11966.10.1016/j.media.2022.102379 ↗
26. Ma · Medical Image Computing and Computer Assisted Intervention—MICCAI 2023 · 2023 · 602
27. Meng · Medical Image Computing and Computer Assisted Intervention—MICCAI 2022 · 2022 · 13436 · 88
28. Meng · Medical Image Computing and Computer Assisted Intervention—MICCAI 2023 · 2023 · 14229 · 750
29. O. Ronneberger, P. Fischer, and T. Brox, “U-Net: Convolutional networks for biomedical image segmentation,” 2015. doi: 10.48550/arXiv.1505.04597.10.1007/978-3-319-24574-4_28 ↗
30. Construction of a 3D probabilistic atlas of human cortical structures10.1016/j.neuroimage.2007.09.031 ↗
31. A. Hoopes, M. Hoffmann, D. N. Greve, B. Fischl, J. Guttag and A. V. Dalca, “Learning the effect of registration hyperparameters with HyperMorph,” 2022. doi: 10.59275/j.melba.2022-74f1.10.59275/j.melba.2022-74f1 ↗
32. Open Access Series of Imaging Studies (OASIS): Cross-sectional MRI data in young, middle aged, nondemented, and demented older adults10.1162/jocn.2007.19.9.1498 ↗
33. P. J. LaMontagne et al., “OASIS-3: Longitudinal neuroimaging, clinical, and cognitive dataset for normal aging and Alzheimer disease,” medRxiv, Dec. 2019. doi: 10.1101/2019.12.13.19014902.10.1101/2019.12.13.19014902 ↗
34. The Alzheimer’s disease neuroimaging initiative 3: Continued innovation for clinical trial improvement10.1016/j.jalz.2016.10.006 ↗
35. Volume-based analysis of 6-month-old infant brain MRI for autism biomarker identification and early diagnosis
36. Measuring the dynamic longitudinal cortex development in infants by reconstruction of temporally consistent cortical surfaces10.1016/j.neuroimage.2013.12.038 ↗
37. Computational neuroanatomy of baby brains: A review10.1016/j.neuroimage.2018.03.042 ↗
38. Construction of 4D high-definition cortical surface atlases of infants: Methods and applications10.1016/j.media.2015.04.005 ↗