Fourier Ptychographic Reconstruction Method of Self-Training Physical Model
Source abstract
Abstract
Fourier ptychographic microscopy is a new microscopic computational imaging technology. A series of low-resolution intensity images are collected by a Fourier ptychographic microscopy system, and high-resolution intensity and phase images are reconstructed from the collected low-resolution images by a reconstruction algorithm. It is a kind of microscopy that can achieve both a large field of view and high resolution. Here in this article, a Fourier ptychographic reconstruction method applied to a self-training physical model is proposed. The SwinIR network in the field of super-resolution is introduced into the reconstruction method for the first time. The input of the SwinIR physical model is modified to a two-channel input, and a data set is established to train the network. Finally, the results of high-quality Fourier stack microscopic reconstruction are realized. The SwinIR network is used as the physical model, and the network hyperparameters and processes such as the loss function and optimizer of the custom network are reconstructed. The experimental results show that by using multiple different types of data sets, the two evaluation index values of the proposed method perform best, and the image reconstruction quality is the best after model training. Two different evaluation indexes are used to quantitatively analyze the reconstruction results through numerical results. The reconstruction results of the fine-tuning data set with some real captured images are qualitatively analyzed from the visual effect. The results show that the proposed method is effective, the network model is stable and feasible, the image reconstruction is realized in a short time, and the reconstruction effect is good.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced X-ray Imaging Techniques · Digital Holography and Microscopy · Advanced Image Processing Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Information and Communication Engineering, Electronics Information Engineering College, Changchun University of Science and Technology, Changchun 130022, China
Electronics Information Engineering College, Changchun University, Changchun 130022, China
School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
Funding
Jilin Provincial Department of Science and Technology
References (53)
Show source-provided references
1. Wide-field, high-resolution Fourier ptychographic microscopy10.1038/nphoton.2013.187 ↗
2. High-resolution, wide-field object reconstruction with synthetic aperture Fourier holographic optical microscopy10.1364/OE.17.007873 ↗
3. Coherent aperture-synthesis, wide-field, highresolution holographic microscopy of biological tissue10.1364/OL.35.001136 ↗
4. Synthetic aperture superresolved microscopy in digital lensless Fourier holography by time and angular multiplexing of the object information10.1364/AO.49.000845 ↗
5. Synthetic aperture holography: A novel approach to threedimensional displays10.1364/JOSAA.9.001969 ↗
6. Short-range synthetic aperture imaging at 633 nm by digital holography10.1364/AO.41.004775 ↗
7. Synthetic aperture superresolution by speckle pattern projection10.1364/OPEX.13.006073 ↗
8. Synthetic Aperture Fourier Holographic Optical Microscopy10.1103/PhysRevLett.97.168102 ↗
9. Synthetic aperture superresolution with multiple off-axis holograms10.1364/JOSAA.23.003162 ↗
10. Synthetic aperture microscopy using off-axis illumination and polarization coding10.1016/j.optcom.2007.04.020 ↗
11. Synthetic aperture single-exposure on-axis digital holography10.1364/OE.16.000161 ↗
12. An improved ptychographical phase retrieval algorithm for diffractive imaging10.1016/j.ultramic.2009.05.012 ↗
13. PhaseLift: Exact and Stable Signal Recovery from Magnitude Measurements via Convex Programming10.1002/cpa.21432 ↗
14. Phase retrieval algorithms: A personal tour [Invited]10.1364/AO.52.000045 ↗
15. A practical algorithm for the determination of phase from image and diffraction plane pictures
16. Phase retrieval algorithms: A comparison10.1364/AO.21.002758 ↗
17. Phase Retrieval and Diversity in Adaptive Optics10.1117/12.7972989 ↗
18. Phase retrieval in crystallography and optics10.1364/JOSAA.7.000394 ↗
19. Optical image encryption based on input plane and Fourier plane random encoding10.1364/OL.20.000767 ↗
20. Phase retrieval from the magnitude of the Fourier transforms of nonperiodic objects10.1364/JOSAA.15.001662 ↗
21. Simultaneous phase and amplitude extraction from a single defocused image of a homogeneous object10.1046/j.1365-2818.2002.01010.x ↗
22. Phase retrieval and differential phase-contrast imaging with low-brilliance X-ray sources10.1038/nphys265 ↗
23. Hard-X-ray lensless imaging of extended objects10.1103/PhysRevLett.98.034801 ↗
24. Deb, K., and Kalyanmoy, D. (2001). Multi-Objective Optimization Using Evolutionary Algorithms, John Wiley & Sons, Inc.
25. Learning and optimization using the clonal selection principle10.1109/TEVC.2002.1011539 ↗
26. A comparison of methods for multiclass support vector machines10.1109/72.991427 ↗
27. Papadimitriou, C.H., and Steiglitz, K. (1982). Combinatorial Optimization: Algorithms and Complexity, Prentice-Hall, Inc.
28. Optimization by simulated annealing10.1126/science.220.4598.671 ↗
29. Neural computation of decisions in optimization problems10.1007/BF00339943 ↗
30. Ant system: Optimization by a colony of cooperating agents10.1109/3477.484436 ↗
31. No free lunch theorems for optimization10.1109/4235.585893 ↗
32. Osuna, E., Freund, R., and Girosit, F. (1997, January 17–19). Training support vector machines: An application to face detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, PR, USA.
33. Multiobjective evolutionary algorithms: A comparative case study and the strength Pareto approach10.1109/4235.797969 ↗
34. Bertsekas, D., and Tsitsiklis, J. (1989). Parallel and Distributed Computation, Athena Scientific.
35. Burke, E.K., and Kendall, G. (2014). Search Methodologies: Introductory Tutorials in Optimization and Decision Support Techniques, Springer.10.1007/978-1-4614-6940-7 ↗
36. Luenberger, D.G., and Ye, Y. (2015). Linear and Nonlinear Programming, Springer Publishing Company, Incorporated.10.1007/978-3-319-18842-3_6 ↗
37. Phase determination for image and diffraction plane pictures in the electron microscope
38. Adaptive step-size strategy for noise-robust Fourier ptychographic microscopy10.1364/OE.24.020724 ↗
39. Fourier ptychographic reconstruction using Wirtinger flow optimization10.1364/OE.23.004856 ↗
40. Multiplexed coded illumination for Fourier Ptychography with an LED array microscope10.1364/BOE.5.002376 ↗
41. Solving Fourier ptychographic imaging problems via neural network modeling and TensorFlow10.1364/BOE.9.003306 ↗
42. Neural network model assisted Fourier ptychography with Zernike aberration recovery and total variation constraint10.1117/1.JBO.26.3.036502 ↗
43. Double-flow convolutional neural network for rapid large field of view Fourier ptychographic reconstruction10.1002/jbio.202000444 ↗
44. Physics-based learning with channel attention for Fourier ptychographic microscopy10.1002/jbio.202100296 ↗
45. Wang, X., Piao, Y., Yu, J., Li, J., Sun, H., Jin, Y., Liu, L., and Xu, T. (2022). Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction. Sensors, 22.10.3390/s22031237 ↗
46. A Fourier Ptychographic Microscopy Reconstruction Method Based on SwinIR Physical Model10.1088/1742-6596/2400/1/012008 ↗
47. Cong, P., Zhou, J., Li, S., Lv, K., and Feng, H. (2022). Citrus Tree Crown Segmentation of Orchard Spraying Robot Based on RGB-D Image and Improved Mask R-CNN. Appl. Sci., 13.10.3390/app13010164 ↗
48. Song, G., and Wang, Z. (2022). An Efficient Hidden Markov Model with Periodic Recurrent Neural Network Observer for Music Beat Tracking. Electronics, 11.10.3390/electronics11244186 ↗
49. Peng, C., Wu, J., Wang, Q., Gui, W., and Tang, Z. (2022). Remaining Useful Life Prediction Using Dual-Channel LSTM with Time Feature and Its Difference. Entropy, 24.10.3390/e24121818 ↗
50. Novitasari, D.C.R., Fatmawati, F., Hendradi, R., Rohayani, H., Nariswari, R., Arnita, A., Hadi, M.I., Saputra, R.A., and Primadewi, A. (2022). Image Fundus Classification System for Diabetic Retinopathy Stage Detection Using Hybrid CNN-DELM. Big Data Cogn. Comput., 6.10.3390/bdcc6040146 ↗
51. Transport of intensity equation: A tutorial10.1016/j.optlaseng.2020.106187 ↗
52. Kovalev, M., Gritsenko, I., Stsepuro, N., Nosov, P., Krasin, G., and Kudryashov, S. (2022). Reconstructing the Spatial Parameters of a Laser Beam Using the Transport-of-Intensity Equation. Sensors, 22.10.3390/s22051765 ↗
53. Liang, J., Cao, J., Sun, G., Zhang, K., Van Gool, L., and Timofte, R. (2021, January 11–17). Swinir: Image restoration using swin transformer. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCVW54120.2021.00210 ↗