journal article·2025-05-06Open access

Bi-Directional Point Flow Estimation with Multi-Scale Attention for Deformable Lung CT Registration

Nahyuk Lee, Taemin Lee

Applied Sciences· Volume 15· Issue 9

Abstract

Deformable lung CT registration plays a crucial role in clinical applications such as respiratory motion tracking, disease progression analysis, and radiotherapy planning. While voxel-based registration has traditionally dominated this domain, it often suffers from high computational costs and sensitivity to intensity variations. In this work, we propose a novel point-based deformable registration framework tailored to the unique challenges of lung CT alignment. Our approach combines geometric keypoint attention at coarse resolutions to enhance the global correspondence with attention-based refinement modules at finer scales to accurately model subtle anatomical deformations. Furthermore, we adopt a bi-directional training strategy that enforces forward and backward consistency through cycle supervision, promoting anatomically coherent transformations. We evaluate our method on the large-scale Lung250M benchmark and achieve state-of-the-art results, significantly surpassing the existing voxel-based and point-based baselines in the target registration accuracy. These findings highlight the potential of sparse geometric modeling for complex respiratory motion and establish a strong foundation for future point-based deformable registration in thoracic imaging.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Medical Imaging Techniques and Applications · Advanced Radiotherapy Techniques · Advanced X-ray and CT Imaging

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

VUNO Inc., Seoul 06541, Republic of Korea

Department of Electronic and AI System Engineering, Kangwon National University, Samcheok 25913, Republic of Korea

Funding

Korea Health Industry Development Institute (KHIDI)

References (48)

Show source-provided references
1. Castillo, R., Castillo, E., Fuentes, D., Ahmad, M., Wood, A.M., Ludwig, M.S., and Guerrero, T. (2013). A reference dataset for deformable image registration spatial accuracy evaluation using the COPDgene study archive. Phys. Med. Biol., 58.10.1088/0031-9155/58/9/2861 ↗
2. ORRN: An ODE-based recursive registration network for deformable respiratory motion estimation with lung 4DCT images10.1109/TBME.2023.3280463 ↗
3. Evaluation of registration methods on thoracic CT: The EMPIRE10 challenge10.1109/TMI.2011.2158349 ↗
4. The Cancer Imaging Archive (TCIA): Maintaining and operating a public information repository10.1007/s10278-013-9622-7 ↗
5. Yasuda, N., Iwasawa, T., Baba, T., Misumi, T., Cheng, S., Kato, S., Utsunomiya, D., and Ogura, T. (2024). Evaluation of Progressive Architectural Distortion in Idiopathic Pulmonary Fibrosis Using Deformable Registration of Sequential CT Images. Diagnostics, 14.10.3390/diagnostics14151650 ↗
6. Eslick, E., Kipritidis, J., Gradinscak, D., Stevens, M., Bailey, D., Harris, B., Booth, J., and Keall, P. (2022). CT Ventilation as a functional imaging modality for lung cancer radiotherapy (CT-vs-PET-Ventilation-Imaging) (Version 1) [Data set]. Cancer Imaging Arch.
7. Learn2Reg: Comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learning10.1109/TMI.2022.3213983 ↗
8. Image registration methods: A survey10.1016/S0262-8856(03)00137-9 ↗
9. Object recognition from local scale-invariant features10.1109/ICCV.1999.790410 ↗
10. Wang, Y., and Solomon, J.M. (November, January 27). Deep closest point: Learning representations for point cloud registration. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
11. Geotransformer: Fast and robust point cloud registration with geometric transformer10.1109/TPAMI.2023.3259038 ↗
12. Alignment by maximization of mutual information10.1023/A:1007958904918 ↗
13. Multi-modal volume registration by maximization of mutual information10.1016/S1361-8415(01)80004-9 ↗
14. Lewis, J.P. (1995, January 16–19). Fast normalized cross-correlation. Proceedings of the Vision Interface, Quebec City, QC, Canada.
15. Heinrich, M.P., Handels, H., and Simpson, I.J. (2015, January 5–9). Estimating large lung motion in COPD patients by symmetric regularised correspondence fields. Proceedings of the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany. Proceedings, Part II 18.10.1007/978-3-319-24571-3_41 ↗
16. Lung250M-4B: A combined 3D dataset for CT-and point cloud-based intra-patient lung registration
17. Wu, W., Wang, Z.Y., Li, Z., Liu, W., and Fuxin, L. (2020, January 23–28). Pointpwc-net: Cost volume on point clouds for (self-) supervised scene flow estimation. Proceedings of the Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK. Proceedings, Part V 16.10.1007/978-3-030-58558-7_6 ↗
18. Liu, X., Qi, C.R., and Guibas, L.J. (2019, January 16–20). Flownet3d: Learning scene flow in 3d point clouds. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00062 ↗
19. Gu, X., Wang, Y., Wu, C., Lee, Y.J., and Wang, P. (2019, January 16–20). Hplflownet: Hierarchical permutohedral lattice flownet for scene flow estimation on large-scale point clouds. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00337 ↗
20. Point set registration: Coherent point drift10.1109/TPAMI.2010.46 ↗
21. Computed tomography–based biomarker provides unique signature for diagnosis of COPD phenotypes and disease progression10.1038/nm.2971 ↗
22. Tumor and normal tissue motion in the thorax during respiration: Analysis of volumetric and positional variations using 4D CT10.1016/j.ijrobp.2006.09.009 ↗
23. MRF-based deformable registration and ventilation estimation of lung CT10.1109/TMI.2013.2246577 ↗
24. Ding, K., Yin, Y., Cao, K., Christensen, G.E., Lin, C.L., Hoffman, E.A., and Reinhardt, J.M. (October, January 27). Evaluation of lobar biomechanics during respiration using image registration. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Strasbourg, France.
25. Surface deformation analysis of collapsed lungs using model-based shape matching10.1007/s11548-019-02013-0 ↗
26. Mass preserving image registration for lung CT10.1016/j.media.2011.11.001 ↗
27. Mass preserving nonrigid registration of CT lung images using cubic B-spline10.1118/1.3193526 ↗
28. Thirion, J.P. (1996, January 18–20). Non-Rigid Matching using Demons. Proceedings of the Computer Vision and Pattern Recognition CVPR’96, San Francisco, CA, USA.10.1109/CVPR.1996.517081 ↗
29. Nonrigid registration using free-form deformations: Application to breast MR images10.1109/42.796284 ↗
30. A Hybrid Algorithm to Address Ambiguities in Deformable Image Registration for Radiation Therapy
31. Schmidt-Richberg, A., Ehrhardt, J., Werner, R., and Handels, H. (2012, January 1–5). Lung registration with improved fissure alignment by integration of pulmonary lobe segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention—MICCAI 2012: 15th International Conference, Nice, France. Proceedings, Part II 15.10.1007/978-3-642-33418-4_10 ↗
32. MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration10.1016/j.media.2012.05.008 ↗
33. Voxelmorph: A learning framework for deformable medical image registration10.1109/TMI.2019.2897538 ↗
34. A deep learning framework for unsupervised affine and deformable image registration10.1016/j.media.2018.11.010 ↗
35. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany. Proceedings, Part III 18.
36. Liu, J., Akin, O., and Tian, Y. (2021, January 27). Rethinking pulmonary nodule detection in multi-view 3D CT point cloud representation. Proceedings of the Machine Learning in Medical Imaging: 12th International Workshop, MLMI 2021, Held in Conjunction with MICCAI 2021, Strasbourg, France. Proceedings 12.10.1007/978-3-030-87589-3_9 ↗
37. Jia, J., Yu, B., Mody, P., Ninaber, M.K., Schouffoer, A.A., de Vries-Bouwstra, J.K., Kroft, L.J., Staring, M., and Stoel, B.C. (2024). Using 3D point cloud and graph-based neural networks to improve the estimation of pulmonary function tests from chest CT. Comput. Biol. Med., 182.10.1016/j.compbiomed.2024.109192 ↗
38. Wu, W., Qi, Z., and Fuxin, L. (2019, January 16–20). Pointconv: Deep convolutional networks on 3d point clouds. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00985 ↗
39. Pointnet++: Deep hierarchical feature learning on point sets in a metric space
40. Qin, Z., Yu, H., Wang, C., Guo, Y., Peng, Y., and Xu, K. (2022, January 19–24). Geometric transformer for fast and robust point cloud registration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01086 ↗
41. Interfractional positional variability of fiducial markers and primary tumors in locally advanced non-small-cell lung cancer during audiovisual biofeedback radiotherapy10.1016/j.ijrobp.2011.10.051 ↗
42. Evaluation of 4-dimensional computed tomography to 4-dimensional cone-beam computed tomography deformable image registration for lung cancer adaptive radiation therapy10.1016/j.ijrobp.2012.12.023 ↗
43. A longitudinal four-dimensional computed tomography and cone beam computed tomography dataset for image-guided radiation therapy research in lung cancer10.1002/mp.12059 ↗
44. Hugo, G.D., Weiss, E., Sleeman, W.C., Balik, S., Keall, P.J., Lu, J., and Williamson, J.F. (2016). Data from 4D Lung Imaging of NSCLC Patients (Version 2) [Data set]. Cancer Imaging Arch.
45. Reduced lung-cancer mortality with low-dose computed tomographic screening10.1056/NEJMoa1102873 ↗
46. Paszke, A. (2019). Pytorch: An imperative style, high-performance deep learning library. arXiv.
47. Kingma, D.P., and Ba, J. (2015, January 7–9). Adam: A Method for Stochastic Optimization. Proceedings of the ICLR, San Diego, CA, USA.
48. Heinrich, M.P., and Hansen, L. (2022, January 10–12). Voxelmorph++ going beyond the cranial vault with keypoint supervision and multi-channel instance optimisation. Proceedings of the International Workshop on Biomedical Image Registration, Munich, Germany.10.1007/978-3-031-11203-4_10 ↗