journal article·2025-01-05Open access

Fourier Ptychographic Microscopy with Optical Aberration Correction and Phase Unwrapping Based on Semi-Supervised Learning

Xuhui Zhou, Haiping Tong, Er Ouyang, Lin Zhao, Hui Fang

Applied Sciences· Volume 15· Issue 1

Abstract

Fourier ptychographic microscopy (FPM) has recently emerged as an important non-invasive imaging technique which is capable of simultaneously achieving high resolution, wide field of view, and quantitative phase imaging. However, FPM still faces challenges in the image reconstruction due to factors such as noise, optical aberration, and phase wrapping. In this work, we propose a semi-supervised Fourier ptychographic transformer network (SFPT) for improved image reconstruction, which employs a two-stage training approach to enhance the image quality. First, self-supervised learning guided by low-resolution amplitudes and Zernike modes is utilized to recover pupil function. Second, a supervised learning framework with augmented training datasets is applied to further refine reconstruction quality. Moreover, the unwrapped phase is recovered by adjusting the phase distribution range in the augmented training datasets. The effectiveness of the proposed method is validated by using both the simulation and experimental data. This deep-learning-based method has potential applications for imaging thicker biology samples.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced X-ray Imaging Techniques · Digital Holography and Microscopy · Optical measurement and interference techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Nanophotonics Research Center, Institute of Microscale Optoelectronics & Shenzhen Key Laboratory of Microscale Optical Information Technology, Shenzhen University, Shenzhen 518060, China

School of Information Science and Engineering, Hunan Institute of Science and Technology, Yueyang 414000, China

Funding

National Natural Science Foundation of China · Shenzhen Science and Technology Major Project · Scientific Instrument Developing Project of Shenzhen University

References (40)

Show source-provided references
1. Wide-field, high-resolution Fourier ptychographic microscopy10.1038/nphoton.2013.187 ↗
2. Concept, implementations and applications of Fourier ptychography10.1038/s42254-021-00280-y ↗
3. Quantitative phase imaging via Fourier ptychographic microscopy10.1364/OL.38.004845 ↗
4. High-resolution and large field-of-view Fourier ptychographic microscopy and its applications in biomedicine10.1088/1361-6633/aba6f0 ↗
5. Xu, F., Wu, Z., Tan, C., Liao, Y., Wang, Z., Chen, K., and Pan, A. (2024). Fourier Ptychographic Microscopy 10 Years on: A Review. Cells, 13.10.3390/cells13040324 ↗
6. Computational illumination for high-speed in vitro Fourier ptychographic microscopy10.1364/OPTICA.2.000904 ↗
7. Self-learning based Fourier ptychographic microscopy10.1364/OE.23.018471 ↗
8. Sun, J., Zuo, C., Zhang, L., and Chen, Q. (2017). Resolution-enhanced Fourier ptychographic microscopy based on high-numerical-aperture illuminations. Sci. Rep., 7.10.1038/s41598-017-01346-7 ↗
9. Sun, J., Zuo, C., Zhang, J., Fan, Y., and Chen, Q. (2018). High-speed Fourier ptychographic microscopy based on programmable annular illuminations. Sci. Rep., 8.10.1038/s41598-018-25797-8 ↗
10. Fourier ptychographic reconstruction using Wirtinger flow optimization10.1364/OE.23.004856 ↗
11. Pan, A., Zhang, Y., Zhao, T., Wang, Z., Dan, D., Lei, M., and Yao, B. (2017). System calibration method for Fourier ptychographic microscopy. J. Biomed. Opt., 22.10.1117/1.JBO.22.9.096005 ↗
12. Deep learning approach for Fourier ptychography microscopy10.1364/OE.26.026470 ↗
13. Fourier ptychography: Current applications and future promises10.1364/OE.386168 ↗
14. Fourier ptychographic microscopy image enhancement with bi-modal deep learning10.1364/BOE.489776 ↗
15. Wang, X., Piao, Y., Jin, Y., Li, J., Lin, Z., Cui, J., and Xu, T. (2023). Fourier Ptychographic Reconstruction Method of Self-Training Physical Model. Appl. Sci., 13.10.3390/app13063590 ↗
16. Wang, Y., Guan, N., Li, J., and Wang, X. (2024). A Virtual Staining Method Based on Self-Supervised GAN for Fourier Ptychographic Microscopy Colorful Imaging. Appl. Sci., 14.10.3390/app14041662 ↗
17. Deep learning for fast image reconstruction of Fourier ptychographic microscopy with expanded frequency spectrum
18. Kappeler, A., Ghosh, S., Holloway, J., Cossairt, O., and Katsaggelos, A. (2017, January 17–20). Ptychnet: CNN based Fourier ptychography. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.10.1109/ICIP.2017.8296574 ↗
19. Fourier ptychographic microscopy reconstruction with multiscale deep residual network10.1364/OE.27.008612 ↗
20. Bardozzo, F., Fiore, P., Valentino, M., Bianco, V., Memmolo, P., Miccio, L., Brancato, V., Smaldone, G., Gambacorta, M., and Salvatore, M. (2024). Enhanced tissue slide imaging in the complex domain via cross-explainable GAN for Fourier ptychographic microscopy. Comput. Biol. Med., 179.10.1016/j.compbiomed.2024.108861 ↗
21. Linear-space-variant model for Fourier ptychographic microscopy10.1364/OL.522745 ↗
22. Blind deep-learning based preprocessing method for Fourier ptychographic microscopy10.1016/j.optlastec.2023.110140 ↗
23. Fourier ptychographic microscopy with untrained deep neural network priors10.1364/OE.472171 ↗
24. Solving Fourier ptychographic imaging problems via neural network modeling and TensorFlow10.1364/BOE.9.003306 ↗
25. Zhang, J., Xu, T., Li, J., Zhang, Y., Jiang, S., Chen, Y., and Zhang, J. (2022). Physics-based learning with channel attention for Fourier ptychographic microscopy. J. Biophotonics, 15.10.1002/jbio.202100296 ↗
26. The integration of neural network and physical reconstruction model for Fourier ptychographic microscopy10.1016/j.optcom.2021.127470 ↗
27. Wang, Y., Wang, Y., Li, J., and Wang, X. (2024). Fourier Ptychographic Microscopy Reconstruction Method Based on Residual Local Mixture Network. Sensors, 24.10.3390/s24134099 ↗
28. Fourier ptychographic reconstruction with denoising diffusion probabilistic models10.1016/j.optlastec.2024.111016 ↗
29. Fast two-dimensional phase-unwrapping algorithm based on sorting by reliability following a noncontinuous path10.1364/AO.41.007437 ↗
30. Robust two-dimensional weighted and unweighted phase unwrapping that uses fast transforms and iterative methods10.1364/JOSAA.11.000107 ↗
31. Multi task deep learning phase unwrapping method based on semantic segmentation10.1088/2040-8986/ad8505 ↗
32. Transformer-based reconstruction for Fourier ptychographic microscopy10.1109/ACCESS.2023.3309878 ↗
33. Zhu, X.J. (2024, December 09). Semi-Aupervised Learning Literature Survey. University of Wisconsin-Madison. Available online: https://pages.cs.wisc.edu/~jerryzhu/pub/ssl_survey.pdf.
34. Embedded pupil function recovery for Fourier ptychographic microscopy10.1364/OE.22.004960 ↗
35. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017, January 4–9). Attention is all you need. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA.
36. When Multigranularity Meets Spatial–Spectral Attention: A Hybrid Transformer for Hyperspectral Image Classification
37. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision, Virtual Conference.10.1109/ICCV48922.2021.00986 ↗
38. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
39. Agustsson, E., and Timofte, R. (2017, January 21–26). Ntire 2017 challenge on single image super-resolution: Dataset and study. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA.10.1109/CVPRW.2017.150 ↗
40. Blood and urine physiological values in farm-cultured Rana catesbeiana (Anura: Ranidae) in Argentina10.15517/rbt.v53i3-4.14669 ↗