journal article·2024Open access

Positron Emission Tomography Lung Image Respiratory Motion Correcting with Equivariant Transformer

Jianfeng He, Haowei Ye, Jie Ning, Hui Zhou, Bo She

Computers, Materials & Continua· Volume 79· Issue 2

Abstract

In addressing the challenge of motion artifacts in Positron Emission Tomography (PET) lung scans, our study introduces the Triple Equivariant Motion Transformer (TEMT), an innovative, unsupervised, deep-learning-based framework for efficient respiratory motion correction in PET imaging. Unlike traditional techniques, which segment PET data into bins throughout a respiratory cycle and often face issues such as inefficiency and overemphasis on certain artifacts, TEMT employs Convolutional Neural Networks (CNNs) for effective feature extraction and motion decomposition.TEMT’s unique approach involves transforming motion sequences into Lie group domains to highlight fundamental motion patterns, coupled with employing competitive weighting for precise target deformation field generation. Our empirical evaluations confirm TEMT’s superior performance in handling diverse PET lung datasets compared to existing image registration networks. Experimental results demonstrate that TEMT achieved Dice indices of 91.40%, 85.41%, 79.78%, and 72.16% on simulated geometric phantom data, lung voxel phantom data, cardiopulmonary voxel phantom data, and clinical data, respectively. To facilitate further research and practical application, the TEMT framework, along with its implementation details and part of the simulation data, is made publicly accessible at .
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Medical Imaging Techniques and Applications · Lung Cancer Diagnosis and Treatment · Radiomics and Machine Learning in Medical Imaging

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (33)

Show source-provided references
1. Diagnostic performance of zero-TE lung MR imaging in FDG PET/MRI for pulmonary malignancies10.1007/s00330-020-06848-z ↗
2. The impact of data-driven respiratory gating in clinical F-18 FDG PET/CT: Comparison of free breathing and deep-expiration breath-hold CT protocol10.1007/s12149-020-01574-4 ↗
3. New challenges for PET image reconstruction for total-body imaging10.1016/j.cpet.2020.06.002 ↗
4. An unsupervised learning model for deformable medical image registration
5. VoxelMorph: A learning framework for deformable medical image registration10.1109/TMI.2019.2897538 ↗
6. Unsupervised 3D end-to-end medical image registration with volume tweening network10.1109/JBHI.2019.2951024 ↗
7. CycleMorph: Cycle consistent unsupervised deformable image registration10.1016/j.media.2021.102036 ↗
8. Attention mechanisms in computer vision: A survey10.1007/s41095-022-0271-y ↗
9. J. Chen, Y. He, E. C. Frey, Y. Li, and Y. Du, “ViT-V-Net: Vision transformer for unsupervised volumetric medical image registration,” 2021. Accessed: Apr. 13, 2021. [Online]. Available: https://arxiv.org/abs/2104.06468
10. TransMorph: Transformer for unsupervised medical image registration10.1016/j.media.2022.102615 ↗
11. Swin-VoxelMorph: A symmetric unsupervised learning model for deformable medical image registration using swin transformer
12. Dual-stream pyramid registration network,Medical image analysis10.1016/j.media.2022.102379 ↗
13. Feature pyramid transformer
14. A survey on vision transformer10.1109/TPAMI.2022.3152247 ↗
15. Deformer: Towards displacement field learning for unsupervised medical image registration
16. XMorpher: Full transformer for deformable medical image registration via cross attention
17. H. Wang, D. Ni, and Y. Wang, “ModeT: Learning deformable image registration via motion decomposition transformer,” 2023. Accessed: Jun. 09, 2023. [Online]. Available: https://arxiv.org/abs/2306.05688
18. Respiratory motion correction on PET images based on 3D convolutional neural network
19. J. Q. Zheng, Z. Wang, B. Huang, N. H. Lim, and B. W. Papiez, “Residual aligner network,” 2022. Accessed: Mar. 07, 2022. [Online]. Available: https://arxiv.org/abs/2203.04290
20. MedDeblur: Medical image deblurring with residual dense spatial-asymmetric attention10.3390/math11010115 ↗
21. Group equivariant convolutional networks
22. Gauge equivariant transformer
23. LieTransformer: Equivariant self-attention for Lie groups
24. P. Ding, D. Soselia, T. Armstrong, J. Su, and F. Huang, “Reviving shift equivariance in vision transformers,” 2023. Accessed: Jun. 13, 2023. [Online]. Available: https://arxiv.org/abs/2306.07470
25. R. Xu, K. Yang, K. Liu, and F. He, “E(2)-equivariant vision transformer,” 2023. Accessed: Jun. 11, 2023. [Online]. Available: https://arxiv.org/abs/2306.06722
26. RAFT-3D: Scene flow using rigid-motion embeddings
27. J. Abderezaei, A. Pionteck, A. Chopra, and M. Kurt, “3D Inception-based TransMorph: Pre- and post-operative multi-contrast MRI registration in brain tumors,” 2022. Accessed: Dec. 08, 2022. [Online]. Available: https://arxiv.org/abs/2212.0457910.1007/978-3-031-44153-0_4 ↗
28. CBAM: Convolutional block attention module
29. Segars · Development and Application of the New Dynamic Nurbs-Based Cardiac-Torso (NCAT) Phantom · 2001
30. Deep learning on computerized analysis of chronic obstructive pulmonary disease10.1109/JBHI.2019.2931395 ↗
31. Multiscale multimodal medical imaging: Third international workshop
32. DeepOCT: An explainable deep learning architecture to analyze macular edema on OCT images
33. A comprehensive report on machine learning-based early detection of Alzheimer’s disease using multi-modal neuroimaging data