2D/3D Multimode Medical Image Alignment Based on Spatial Histograms
Source abstract
Abstract
The key to image-guided surgery (IGS) technology is to find the transformation relationship between preoperative 3D images and intraoperative 2D images, namely, 2D/3D image registration. A feature-based 2D/3D medical image registration algorithm is investigated in this study. We use a two-dimensional weighted spatial histogram of gradient directions to extract statistical features, overcome the algorithm’s limitations, and expand the applicable scenarios under the premise of ensuring accuracy. The proposed algorithm was tested on CT and synthetic X-ray images, and compared with existing algorithms. The results show that the proposed algorithm can improve accuracy and efficiency, and reduce the initial value’s sensitivity.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Technologies in Various Fields · Medical Image Segmentation Techniques · 3D Shape Modeling and Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Automation, University of Electronic Science and Technology of China, Chengdu 610054, China
College of Computer Science and Cyber Security, Chengdu University of Technology, Chengdu 610059, China
Department of Geography and Anthropology, Louisiana State University, Baton Rouge, LA 70803, USA
Funding
Sichuan Science and Technology Program
References (39)
Show source-provided references
1. Image-guided interventions: Technology review and clinical applications10.1146/annurev-bioeng-070909-105249 ↗
2. Steininger, P., Neuner, M., Fritscher, K., Sedlmayer, F., and Deutschmann, H. (2011, January 12–17). A novel class of machine-learning-driven real-time 2D/3D tracking methods: Texture model registration (TMR). Proceedings of the Medical Imaging 2011: Visualization, Image-Guided Procedures, and Modeling: International Society for Optics and Photonics, Lake Buena Vista, FL, USA.10.1117/12.878147 ↗
3. Influence of nonlinear soft tissue modeling on the external and internal forces during lateral hip impacts10.1016/j.jmbbm.2021.104743 ↗
4. Construction of force haptic reappearance system based on Geomagic Touch haptic device10.1016/j.cmpb.2020.105344 ↗
5. Motion prediction via online instantaneous frequency estimation for vision-based beating heart tracking10.1016/j.inffus.2016.09.004 ↗
6. A triangular radial cubic spline deformation model for efficient 3D beating heart tracking10.1007/s11760-017-1090-y ↗
7. 2D/3D image fusion for accurate target localization and evaluation of a mask based stereotactic system in fractionated stereotactic radiotherapy of cranial lesions10.1118/1.2392605 ↗
8. Reconstructing a 3D heart surface with stereo-endoscope by learning eigen-shapes10.1364/BOE.9.006222 ↗
9. Sparse-view CBCT reconstruction via weighted Schatten p-norm minimization10.1364/OE.404471 ↗
10. A New Algorithm for Distributed Control Problem with Shortest-Distance Constraints10.1155/2016/1604824 ↗
11. Medical image registration in image guided surgery: Issues, challenges and research opportunities10.1016/j.bbe.2017.10.001 ↗
12. Intraoperative imaging-guided cancer surgery: From current fluorescence molecular imaging methods to future multi-modality imaging technology10.7150/thno.9899 ↗
13. Evaluation of medical image registration techniques based on nature and domain of the transformation10.1016/j.jmir.2015.12.081 ↗
14. A fast, accurate, and automatic 2D–3D image registration for image-guided cranial radiosurgery10.1118/1.2903431 ↗
15. An investigation towards issues and challenges in medical image registration
16. Intraoperative image-based multiview 2D/3D registration for image-guided orthopaedic surgery: Incorporation of fiducial-based C-arm tracking and GPU-acceleration10.1109/TMI.2011.2176555 ↗
17. Stochastic rank correlation: A robust merit function for 2D/3D registration of image data obtained at different energies10.1118/1.3157111 ↗
18. Markelj, P., Tomaževič, D., Pernuš, F., and Likar, B. (2007, January 17–22). Optimizing bone extraction in MR images for 3D/2D gradient based registration of MR and X-ray images. Proceedings of the Medical Imaging 2007: Image Processing: International Society for Optics and Photonics, San Diego, CA, USA.10.1117/12.709259 ↗
19. A CNN regression approach for real-time 2D/3D registration10.1109/TMI.2016.2521800 ↗
20. Pairwise domain adaptation module for CNN-based 2-D/3-D registration10.1117/1.JMI.5.2.021204 ↗
21. Tang, T.S., Ellis, R.E., and Fichtinger, G. (2020, January 4–8). Fiducial registration from a single X-Ray image: A new technique for fluoroscopic guidance and radiotherapy. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Lima, Peru.
22. Zheng, J., Miao, S., and Liao, R. (2017, January 10–14). Learning CNNS with pairwise domain adaption for real-time 6dof ultrasound transducer detection and tracking from x-ray images. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Quebec City, QC, Canada.10.1007/978-3-319-66185-8_73 ↗
23. Zheng, G., Zhang, X., Jonić, S., Thévenaz, P., Unser, M., and Nolte, L.-P. (2006, January 9–11). Point similarity measures based on MRF modeling of difference images for spline-based 2D-3D rigid registration of X-ray fluoroscopy to CT images. Proceedings of the International Workshop on Biomedical Image Registration, Utrecht, The Netherlands.10.1007/11784012_23 ↗
24. Pan, H., Zhou, C., Zhu, Q., and Zheng, D. (2018, January 9–12). A fast registration from 3D CT images to 2D X-ray images. Proceedings of the 2018 IEEE 3rd International Conference on Big Data Analysis (ICBDA): IEEE, Shanghai, China.10.1109/ICBDA.2018.8367706 ↗
25. Fast generation of digitally reconstructed radiographs using attenuation fields with application to 2D-3D image registration10.1109/TMI.2005.856749 ↗
26. 3-D/2-D registration of CT and MR to X-ray images10.1109/TMI.2003.819277 ↗
27. Robust and fast initialization for intensity-based 2D/3D registration10.1155/2014/989254 ↗
28. Accurate and precise 2D–3D registration based on X-ray intensity10.1016/j.cviu.2007.05.006 ↗
29. 3-D/2-D registration by integrating 2-D information in 3-D10.1109/TMI.2005.859715 ↗
30. A computationally efficient 3D/2D registration method based on image gradient direction probability density function10.1016/j.neucom.2016.07.070 ↗
31. 3D/2D model-to-image registration by imitation learning for cardiac procedures10.1007/s11548-018-1774-y ↗
32. Johnson, H., McCormick, M., and Ibanez, L. (2015). The ITK Software Guide Book 2: Design and Functionality-Volume 2, Kitware Inc.
33. Li, H., Wang, J., and Han, C. (2020, January 13–14). Image Mosaic and Hybrid Fusion Algorithm Based on Pyramid Decomposition. Proceedings of the 2020 International Conference on Virtual Reality and Visualization (ICVRV), Galinhas, Brazil.10.1109/ICVRV51359.2020.00049 ↗
34. Birchfield, S.T., and Rangarajan, S. (2005, January 20–25). Spatiograms versus histograms for region-based tracking. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05): IEEE, San Diego, CA, USA.
35. Zhang, Z., Liu, Y., Tian, J., Liu, S., Yang, B., Xiang, L., Yin, L., and Zheng, W. (2021). Study on Reconstruction and Feature Tracking of Silicone Heart 3D Surface. Sensors, 21.10.3390/s21227570 ↗
36. 2D/3D registration system based on single X-ray image and CT data
37. Research and improvement of feature detection algorithm based on FAST10.1007/s12210-021-01020-1 ↗
38. Deng, Y., Tang, Y., Yang, B., Zheng, W., Liu, S., and Liu, C. (2021, January 3–5). A Review of Bilateral Teleoperation Control Strategies with Soft Environment. Proceedings of the 2021 6th IEEE International Conference on Advanced Robotics and Mechatronics (ICARM): IEEE, Chongqing, China.10.1109/ICARM52023.2021.9536056 ↗
39. Wang, Y., Tian, J., Liu, Y., Yang, B., Liu, S., Yin, L., and Zheng, W. (2021). Adaptive Neural Network Control of Time Delay Teleoperation System Based on Model Approximation. Sensors, 21.10.3390/s21227443 ↗