Ultra‐Wide‐Field Noninvasive Imaging Through Scattering Media Via Physics‐Guided Deep Learning
Source abstract
Abstract
ABSTRACT Noninvasive imaging through scattering media is crucial for diverse applications but remains constrained by a narrow field of view (FOV). Although recent learning‐based methods have a larger FOV, they often require large‐scale real experimental datasets and struggle when the FOV is far beyond the optical memory effect (OME). Here, we propose a physics‐guided adaptive dual‐domain diffusion model for ultra‐wide‐field noninvasive imaging through scattering media, namely UNI‐Net. Specifically, we first develop a physical scattering imaging model to synthesize large‐scale pre‐training data, thereby reducing dependence on real experimental datasets. Second, to maximize the utilization of speckle information, we partition each speckle pattern into multi‐channel patches to guide the diffusion process. Third, we propose a spatial‐channel parallel attention block to model the spatial sparsity and inter‐channel similarity of speckle patches with linear complexity. Extensive experiments show that our method cuts reliance on real experimental data by an order of magnitude and achieves a PSNR of 31.23 dB at a 41 OME range in complex scenes, which is 49.5% higher than existing approaches while requiring significantly lower computational and memory costs. Even at an extreme 164 OME range where other methods fail, it still reliably reconstructs complex scenes with a PSNR of 27.21 dB.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Random lasers and scattering media · Sparse and Compressive Sensing Techniques · Digital Holography and Microscopy
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electrical and Electronic Engineering Nanyang Technological University Singapore Singapore
State Key Laboratory of Environment Characteristics and Effects for Near‐space & State Key Laboratory of CNS/ATM Beijing Institute of Technology Beijing China
School of Electrical Sciences Indian Institute of Technology Goa Goa India
Funding
Natural Science Foundation of Beijing Municipality · National Research Foundation Singapore
References (52)
Show source-provided references
1. 10.1038/s41566-020-0612-210.1038/s41566-020-0612-2 ↗
2. 10.1038/s41592-025-02692-510.1038/s41592-025-02692-5 ↗
3. 10.1038/ncomms827610.1038/ncomms8276 ↗
4. 10.1038/s41467-025-60460-710.1038/s41467-025-60460-7 ↗
5. 10.1038/s41377-024-01569-010.1038/s41377-024-01569-0 ↗
6. 10.1038/nphoton.2015.2410.1038/nphoton.2015.24 ↗
7. 10.1038/s41566-017-0088-x10.1038/s41566-017-0088-x ↗
8. 10.1038/nphoton.2012.36110.1038/nphoton.2012.361 ↗
9. 10.1038/nmeth.148310.1038/nmeth.1483 ↗
10. 10.1038/nphoton.2010.8510.1038/nphoton.2010.85 ↗
11. 10.1038/nphoton.2015.14010.1038/nphoton.2015.140 ↗
12. 10.1038/nphoton.2013.3110.1038/nphoton.2013.31 ↗
13. 10.1038/nphoton.2012.20510.1038/nphoton.2012.205 ↗
14. 10.1103/PhysRevLett.107.02390210.1103/PhysRevLett.107.023902 ↗
15. 10.1038/nphoton.2013.30710.1038/nphoton.2013.307 ↗
16. 10.1038/s41566-019-0439-x10.1038/s41566-019-0439-x ↗
17. 10.1038/nphoton.2014.10710.1038/nphoton.2014.107 ↗
18. 10.1038/nature2548910.1038/nature25489 ↗
19. 10.1364/OPTICA.4.00088610.1364/OPTICA.4.000886 ↗
20. 10.1103/PhysRevLett.61.232810.1103/PhysRevLett.61.2328 ↗
21. 10.1038/nature1157810.1038/nature11578 ↗
22. 10.1038/nphoton.2014.18910.1038/nphoton.2014.189 ↗
23. 10.1364/OE.24.01373810.1364/OE.24.013738 ↗
24. 10.1038/nature1453910.1038/nature14539 ↗
25. 10.1364/OPTICA.5.00080310.1364/OPTICA.5.000803 ↗
26. 10.1364/OPTICA.5.00118110.1364/OPTICA.5.001181 ↗
27. 10.1364/OL.49879610.1364/OL.498796 ↗
28. 10.1364/PRJ.41655110.1364/PRJ.416551 ↗
29. 10.1088/2040-8986/adb44010.1088/2040-8986/adb440 ↗
30. 10.1016/j.optcom.2024.13094310.1016/j.optcom.2024.130943 ↗
31. Attention Is All You Need
32. 10.1364/OE.38391110.1364/OE.383911 ↗
33. 10.1364/OL.48486710.1364/OL.484867 ↗
34. 10.1364/PRJ.52372810.1364/PRJ.523728 ↗
35. Denoising Diffusion Probabilistic Models
36. T.DaoandA.Gu “Transformers Are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality ” inInternational Conference on Machine Learning(2024) 10 041–10 071.
37. Demystify Mamba in Vision: A Linear Attention Perspective
38. G.Cohen S.Afshar J.Tapson andA.Van Schaik “Emnist: Extending Mnist to Handwritten Letters ” inInternational Joint Conference on Neural Networks(IEEE 2017) 2921–2926.10.1109/IJCNN.2017.7966217 ↗
39. H.Xiao K.Rasul andR.Vollgraf “Fashion‐MNIST: A Novel Image Dataset for Benchmarking Machine Learning Algorithms ”arXiv Preprint arXiv:1708.07747(2017).
40. A.Krizhevsky G.Hinton et al. “Learning Multiple Layers of Features from Tiny Images ” (2009).
41. 10.1364/OE.27.03716410.1364/OE.27.037164 ↗
42. Huang G. B. · 2008 · 07
43. O.Ronneberger P.Fischer andT.Brox “U‐Net: Convolutional Networks for Biomedical Image Segmentation ” inInternational Conference on Medical Image Computing and Computer‐Assisted Intervention(Springer 2015) 234–241.10.1007/978-3-319-24574-4_28 ↗
44. Generative Modeling by Estimating Gradients of the Data Distribution
45. A Survey on Vision Mamba: Models, Applications and Challenges
46. Y.Song J.Sohl‐Dickstein D. P.Kingma A.Kumar S.Ermon andB.Poole “Score‐Based Generative Modeling Through Stochastic Differential Equations ” inInternational Conference on Learning Representations.
47. A.Gu K.Goel andC.Re “Efficiently Modeling Long Sequences with Structured State Spaces ” inInternational Conference on Learning Representations.
48. A.GuandT.Dao “Mamba: Linear‐Time Sequence Modeling with Selective State Spaces ”arXiv Preprint arXiv:2312.00752(2023).
49. On the Connection Between Local Attention and Dynamic Depth‐Wise Convolution
50. Z.‐Q. J.Xu Y.Zhang andY.Xiao “Training Behavior of Deep Neural Network in Frequency Domain ” inInternational Conference on Neural Information Processing(Springer 2019) 264–274.10.1007/978-3-030-36708-4_22 ↗
51. S.‐Y.Wang O.Wang R.Zhang A.Owens andA. A.Efros “Cnn‐Generated Images Are Surprisingly Easy to Spot… For Now ” inIEEE Conference on Computer Vision and Pattern Recognition(2020) 8695–8704.10.1109/CVPR42600.2020.00872 ↗
52. X.Zhang S.Karaman and S.‐F.Chang “Detecting and Simulating Artifacts in Gan Fake Images ” inIEEE International Workshop on Information Forensics and Security(2019) 1–6.10.1109/WIFS47025.2019.9035107 ↗