journal article·2025-11-17Open access

Vascular-Aware Multimodal MR–PET Reconstruction for Early Stroke Detection: A Physics-Informed, Topology-Preserving, Adversarial Super-Resolution Framework

Krzysztof Malczewski

Applied Sciences· Volume 15· Issue 22

Abstract

Rapid and reliable identification of large vessel occlusions and critical stenoses is essential for guiding treatment in acute ischemic stroke. Conventional MR angiography (MRA) and PET protocols are constrained by trade-offs among acquisition time, spatial resolution, and motion tolerance. A multimodal MR–PET angiography reconstruction framework is introduced that integrates joint Hankel-structured sparsity with topology-preserving multitask learning to overcome these limitations. High-resolution time-of-flight MRA and perfusion-sensitive PET volumes are reconstructed from undersampled data using a cross-modal low-rank Hankel prior coupled to a super-resolution generator optimized with adversarial, perceptual, and pixel-wise losses. Vesselness filtering and centerline continuity terms enforce preservation of fine arterial topology, while learned k-space and sinogram sampling concentrate measurements within vascular territories. Motion correction, blind deblurring, and modality-specific denoising are embedded to improve robustness under clinical conditions. A multitask output head estimates occlusion probability, stenosis localization, and collateral flow, with hypoperfusion mapping generated for dynamic PET. Evaluation on clinical and synthetically undersampled MR–PET studies demonstrated consistent improvements over MR-only, PET-only, and conventional fusion methods. The framework achieved higher image quality (MRA PSNR gains up to 3.7 dB and SSIM improvements of 0.042), reduced vascular topology breaks by over 20%, and improved large vessel occlusion detection by nearly 10% in AUROC, while maintaining at least a 40% reduction in sampling. These findings demonstrate that embedding vascular-aware priors within a joint Hankel–sparse MR–PET framework enables accelerated acquisition with clinically relevant benefits for early stroke assessment.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced MRI Techniques and Applications · Acute Ischemic Stroke Management · Medical Imaging Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of Information Technology, Warsaw University of Life Sciences, Nowoursynowska 159 (Building 34), 02-776 Warsaw, Poland

References (57)

Show source-provided references
1. Time Is Brain—Quantified10.1161/01.STR.0000196957.55928.ab ↗
2. Endovascular Thrombectomy after Large-Vessel Ischemic Stroke: A Meta-Analysis of Individual Patient Data from Five Randomized Trials10.1016/S0140-6736(16)00163-X ↗
3. Test–retest reliability of fNIRS in resting-state cortical activity and brain network assessment in stroke patients10.1364/BOE.491610 ↗
4. fNIRS Biomarkers for Stratifying Poststroke Cognitive Impairment: Evidence From Frontal and Temporal Cortex Activation10.1161/STROKEAHA.124.050269 ↗
5. Magnetic Resonance Angiography10.1148/radiology.161.3.3786721 ↗
6. Acute Ischemic Stroke: Imaging Beyond Thrombolysis
7. Performance Measurements of the Siemens mMR Integrated Whole-Body PET/MR Scanner10.2967/jnumed.111.092726 ↗
8. Design and Performance Evaluation of a Whole-Body Ingenuity TF PET/MRI System10.1088/0031-9155/56/10/013 ↗
9. Nonlinear Total Variation Based Noise Removal Algorithms10.1016/0167-2789(92)90242-F ↗
10. Sparse MRI: The Application of Compressed Sensing for Rapid MR Imaging10.1002/mrm.21391 ↗
11. Annihilating Filter-Based Low-Rank Hankel Matrix Approach for Image Reconstruction
12. Acceleration of MR Imaging via Deep Learning
13. Deep learning for fast super-resolution ultrasound microvessel imaging10.1088/1361-6560/ad0a5a ↗
14. Deep learning for fast denoising filtering in ultrasound localization microscopy10.1088/1361-6560/acf98f ↗
15. Deep Generative Adversarial Neural Networks for Compressive Sensing MRI10.1109/TMI.2018.2858752 ↗
16. Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., and Courville, A.C. (2017, January 4–9). Improved Training of Wasserstein GANs. Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS), Long Beach, CA, USA.
17. BPGAN: Brain PET Synthesis from MRI Using Generative Adversarial Network for Multi-Modal Alzheimer’s Disease Diagnosis10.1016/j.cmpb.2022.106676 ↗
18. Synergistic PET–MR Reconstruction Based on Multi-Class Total Variation
19. Evaluation of Anatomical Priors for Brain PET/MRI Reconstruction
20. Joint MR–PET Reconstruction Using a Multi-Channel Image Regularizer10.1109/TMI.2016.2564989 ↗
21. Fast Virtual Stenting for Thoracic Endovascular Aortic Repair of Aortic Dissection Using Graph Deep Learning10.1109/JBHI.2025.3540712 ↗
22. Model-Based Quantitation of 3-D Magnetic Resonance Angiographic Images10.1109/42.811279 ↗
23. Law, M.W.K., and Chung, A.C.S. (2008, January 12–18). Three Dimensional Curvilinear Structure Detection Using Optimally Oriented Flux. Proceedings of the 10th European Conference on Computer Vision (ECCV), Marseille, France.10.1007/978-3-540-88693-8_27 ↗
24. B2-ViT Net: Broad Vision Transformer Network with Broad Attention for Seizure Prediction10.1109/TNSRE.2023.3346955 ↗
25. Fung, Y.-C. (1997). Biomechanics: Circulation, Springer. [2nd ed.].10.1007/978-1-4757-2696-1 ↗
26. Pedley, T.J. (1980). The Fluid Mechanics of Large Blood Vessels, Cambridge University Press.10.1017/CBO9780511896996 ↗
27. Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information10.1109/TIT.2005.862083 ↗
28. Quantitative evaluation of several partial Fourier reconstruction algorithms used in MRI10.1002/mrm.1910300109 ↗
29. Homodyne detection in magnetic resonance imaging10.1109/42.79473 ↗
30. Inflow Effects in Time-of-Flight MRA
31. Whole-Brain Time-of-Flight MR Angiography at 7T
32. Phase-Contrast MRA with Undersampled Cartesian Encoding and Velocity
33. DAGAN: Deep De-Aliasing GAN for Fast Compressed Sensing MRI Reconstruction10.1109/TMI.2017.2785879 ↗
34. Accelerated Image Reconstruction Using Ordered Subsets of Projection Data10.1109/42.363108 ↗
35. Fast Reconstruction of 3D PET Data with Accurate Statistical Modeling10.1109/23.681983 ↗
36. Bayesian Reconstruction and Use of Anatomical A Priori Information for PET10.1109/42.538945 ↗
37. Synergistic PET/MR Image Restoration Using Multiresolution Joint Patch-Based Sparse Recovery
38. A Joint Group Sparsity-Based Deep Learning for Multi-Contrast MRI Reconstruction10.1016/j.jmr.2022.107354 ↗
39. MIST: A Multimodal Transformer for Accelerated MRI Reconstruction
40. Cross-Modal Transformer for Joint PET–MR Image Reconstruction
41. Cheng, J., Tamir, J., and Liang, D. (2023). Physics-Guided Deep Reconstruction for Accelerated MRI. Magn. Reson. Med., in press.
42. Pi-Recon: Physics-Informed Deep Learning for Reliable MRI Reconstruction
43. Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms10.1023/B:VISI.0000043755.93987.aa ↗
44. MIND: Modality Independent Neighbourhood Descriptor for Multi-Modal Deformable Registration10.1016/j.media.2012.05.008 ↗
45. Balakrishnan, G., Zhao, A., Sabuncu, M.R., Guttag, J., and Dalca, A.V. (2018, January 18–23). An Unsupervised Learning Model for Deformable Medical Image Registration. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00964 ↗
46. A Fast Diffeomorphic Image Registration Algorithm10.1016/j.neuroimage.2007.07.007 ↗
47. Dalca, A.V., Balakrishnan, G., Guttag, J., and Sabuncu, M.R. (2018;, January 16–20). Unsupervised Learning for Fast Probabilistic Diffeomorphic Registration. Proceedings of the Medical Image Computing and Computer-Assisted Intervention (MICCAI), Granada, Spain.10.1007/978-3-030-00928-1_82 ↗
48. TransReg: Transformer-Based Registration Network for Medical Image Registration
49. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., and Kaiser, Ł. (2017, January 4–9). Polosukhin, Attention Is All You Need. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS 2017), Long Beach, CA, USA.
50. Image Reconstruction Using UNET-Transformer Network for Fast and Low-Dose PET Scans10.1016/j.compmedimag.2023.102315 ↗
51. Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., Qiao, Y., and Loy, C.C. (2018, January 8–14). ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks. Proceedings of the 15th European Conference on Computer Vision (ECCV) Workshops, Munich, Germany.10.1007/978-3-030-11021-5_5 ↗
52. Shi, W., Caballero, J., Huszár, F., Totz, J., Aitken, A.P., Bishop, R., Rueckert, D., and Wang, Z. (2016, January 27–30). Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.207 ↗
53. Learning-Based Optimization of the Under-Sampling Pattern in MRI10.1109/TCI.2020.3006727 ↗
54. Bouhachi, S. (2019, January 8–11). Angiographic Vessel Sharpness Index for Image Quality Assessment. Proceedings of the 2019 IEEE International Symposium on Biomedical Imaging (ISBI), Venice, Italy.
55. Hosmer, D.W., Lemeshow, S., and Sturdivant, R.X. (2013). Applied Logistic Regression, Wiley. [3rd ed.].10.1002/9781118548387 ↗
56. PET Image Reconstruction Using Deep Image Prior10.1109/TMI.2018.2888491 ↗
57. Wang, S., Xiao, T., Liu, Q., and Zheng, H. (2020). Deep Learning for Fast MR Imaging: A Review for Learning Reconstruction from Incomplete k-Space Data. arXiv.10.1016/j.bspc.2021.102579 ↗