journal article·2025-04-22Open access

MCANet: An Unsupervised Multi-Constraint Cascaded Attention Network for Accurate and Smooth Brain Medical Image Registration

Min Huang, Haoyu Wang, Guanyu Ren

Applied Sciences· Volume 15· Issue 9

Abstract

Brain medical image registration is a fundamental premise for the computer-assisted treatment of brain diseases. The brain is one of the most important and complex organs of the human body, and it is very challenging to perform accurate and fast registration on it. Aiming at the problem of voxel folding in the deformation field and low registration accuracy when facing complex and fine objects, this paper proposed a fully convolutional multi-constraint cascaded attention network (MCANet). The network is composed of two registration sub-network cascades and performs coarse-to-fine registration of input image pairs in an iterative manner. The registration subnetwork is called the dilated self-attention network (DSNet), which incorporates dilated convolution combinations with different dilation rates and attention gate modules. During the training of MCANet, a double regularization constraint was applied to punish, in a targeted manner, the excessive deformation problem, so that the network can generate relatively smooth deformation while having high registration accuracy. Experimental results on the Mindboggle101 dataset showed that the registration accuracy of MCANet was significantly better than several existing advanced registration methods, and the network can complete relatively smooth registration.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Brain Tumor Detection and Classification · Advanced Neural Network Applications · Medical Image Segmentation Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Software Engineering, Zhengzhou University of Light Industry, Zhengzhou 453000, China

Funding

Henan Provincial Department of Science and Technology Research Project

References (34)

Show source-provided references
1. Imagenet classification with deep convolutional neural networks
2. MRI-based brain tumour image detection using CNN based deep learning method10.1016/j.neuri.2022.100060 ↗
3. Deep graph-based multimodal feature embedding for endomicroscopy image retrieval10.1109/TNNLS.2020.2980129 ↗
4. A review of multimodal image matching: Methods and applications10.1016/j.inffus.2021.02.012 ↗
5. A review of deep-learning-based three-dimensional medical image registration methods10.21037/qims-21-175 ↗
6. Unberath, M., Gao, C., Hu, Y., Judish, M., Taylor, R., Arm, M., and Grupp, R. (2021). The impact of machine learning on 2d/3d registration for image-guided interventions: A systematic review and perspective. Front. Robot. AI, 8.10.3389/frobt.2021.716007 ↗
7. Chen, X., Diaz-Pinto, A., Ravikumar, N., and Frangi, A. (2021). Deep learning in medical image registration. Prog. Biomed. Eng., 3.10.1088/2516-1091/abd37c ↗
8. Lei, Y., Fu, Y., Wang, T., Liu, Y., Patel, P., Curran, W., and Yang, X. (2020). 4D-CT deformable image registration using multiscale unsupervised deep learning. Phys. Med. Biol., 65.10.1088/1361-6560/ab79c4 ↗
9. CycleMorph: Cycle consistent unsupervised deformable image registration10.1016/j.media.2021.102036 ↗
10. Artificial intelligence in tongue diagnosis: Using deep convolutional neural network for recognizing unhealthy tongue with toothmark10.1016/j.csbj.2020.04.002 ↗
11. Chaotic image encryption algorithm based on zigzag transform with bidirectional crossover from random position10.1109/ACCESS.2021.3099214 ↗
12. Adversarial learning for mono-or multi-modal registration10.1016/j.media.2019.101545 ↗
13. BIRNet: Brain image registration using dual-supervised fully convolutional networks10.1016/j.media.2019.03.006 ↗
14. Yang, G., Aviles-Rivero, A., Roberts, M., and Schönlieb, C. (2022). Recursive Deformable Image Registration Network with Mutual Attention. Medical Image Understanding and Analysis, Springer International Publishing.10.1007/978-3-031-12053-4 ↗
15. Spatial transformer networks
16. De Vos, B.D., Berendsen, F.F., Viergever, M.A., Staring, M., and Išgum, I. (2017, January 14). End-to-end unsupervised deformable image registration with a convolutional neural network. Proceedings of the International Workshop on Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, Québec, Canada.10.1007/978-3-319-67558-9_24 ↗
17. VoxelMorph: A learning framework for deformable medical image registration10.1109/TMI.2019.2897538 ↗
18. Kuang, D., and Schmah, T. (2019, January 13). Faim–a convnet method for unsupervised 3d medical image registration. Proceedings of the International Workshop on Machine Learning in Medical Imaging, Shenzhen, China.10.1007/978-3-030-32692-0_74 ↗
19. Unsupervised 3D end-to-end medical image registration with volume tweening network10.1109/JBHI.2019.2951024 ↗
20. Elastix: A toolbox for intensity-based medical image registration10.1109/TMI.2009.2035616 ↗
21. TransMorph: Transformer for unsup- ervised medical image registration10.1016/j.media.2022.102615 ↗
22. Klein, A., and Tourville, J. (2012). 101 labeled brain images and a consistent human cortical labeling protocol. Front. Neurosci., 6.10.3389/fnins.2012.00171 ↗
23. Open access series of imaging studies (oasis): Cross-sectional mri data in young, middle aged, nondemented, and demented older adults10.1162/jocn.2007.19.9.1498 ↗
24. Advanced normalization tools (ANTS)
25. An Unsupervised 3D Image Registration Network for Brain MRI Deformable Registration10.1155/2022/9246378 ↗
26. Wang, P., Chen, P., Yuan, Y., Liu, D., Huang, Z., Hou, X., and Cottrell, G. (2018, January 12–15). Understanding convolution for semantic segmentation. Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA.10.1109/WACV.2018.00163 ↗
27. Yang, J., Yang, J., Zhao, F., and Zhang, W. (2021). An unsupervised multi-scale framework with attention-based network (MANet) for lung 4D-CT registration. Phys. Med. Biol., 66.10.1088/1361-6560/ac0afc ↗
28. Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N.Y., and Kainz, B. (2018). Attention u-net: Learning where to look for the pancreas. arXiv.
29. Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. arXiv.
30. Luong, M.T., Pham, H., and Manning, C.D. (2015). Manning, Effective approaches to attention-based neural machine translation. arXiv.10.18653/v1/D15-1166 ↗
31. Application of normalized cross correlation to image registration10.15623/ijret.2014.0317003 ↗
32. Consistent landmark and intensity-based image registration10.1109/TMI.2002.1009381 ↗
33. Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain10.1016/j.media.2007.06.004 ↗
34. Computing large deformation metric mappings via geodesic flows of diffeomorphisms10.1023/B:VISI.0000043755.93987.aa ↗