Single-Pixel Imaging Based on Enhanced Multi-Network Prior
Source abstract
Abstract
Single-pixel imaging (SPI) is a significant branch of computational imaging. Owing to the high sensitivity, low cost, and wide spectrum, it acquires extensive applications across various domains. Nevertheless, multiple measurements and long reconstruction time constrain its application. The application of neural networks has significantly improved the quality of reconstruction, but there is still a huge space for improvement in performance. SAE and Unet have different advantages in the field of SPI. However, there is no method that combines the advantages of these two networks for SPI reconstruction. Therefore, we propose the EMNP-SPI method for SPI reconstruction using SAE and Unet networks. The SAE makes use of the measurement dimension information and uses the group inverse to obtain the decoding matrix to enhance its generalization. The Unet uses different size convolution kernels and attention mechanisms to enhance feature extraction capabilities. Simulations and experiments confirm that our proposed enhanced multi-network prior method can significantly improve the quality of image reconstruction at low measurement rates.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Random lasers and scattering media · Advanced Optical Sensing Technologies · Quantum optics and atomic interactions
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China
University of Chinese Academy of Sciences, Beijing 100049, China
Funding
National Science Basic Research Plan in Shaanxi Province of China
References (48)
Show source-provided references
1. Single-pixel imaging via compressive sampling10.1109/MSP.2007.914730 ↗
2. Compressed sensing for ultra-weak light counting imaging10.3788/OPE.20122010.2283 ↗
3. Optical machine learning with incoherent light and a single-pixel detector10.1364/OL.44.005186 ↗
4. Study of single pixel imaging system based on compressive sensing
5. Simultaneous real-time visible and infrared video with single-pixel detectors10.1038/srep10669 ↗
6. 3D computational imaging with single-pixel detectors10.1126/science.1234454 ↗
7. Tabletop X-ray ghost imaging with ultra-low radiation10.1364/OPTICA.5.000374 ↗
8. Gong, W., Zhao, C., Yu, H., Chen, M., Xu, W., and Han, S. (2016). Three-dimensional ghost imaging lidar via sparsity constraint. Sci. Rep., 6.10.1038/srep26133 ↗
9. Compressive fluorescence microscopy for biological and hyperspectral imaging10.1073/pnas.1119511109 ↗
10. Ghost spintronic THz-emitter-array microscope10.1038/s41377-020-0338-4 ↗
11. Single-pixel super-resolution with a space-time modulated computational metasurface imager10.1364/PRJ.532222 ↗
12. 1000 FPS computational ghost imaging using LED-based structured illumination10.1364/OE.26.002427 ↗
13. Single pixel imaging at megahertz switching rates via cyclic Hadamard masks10.1038/s41467-021-24850-x ↗
14. Robust real-time single-pixel imaging based on a spinning mask via differential detection10.1364/OE.546122 ↗
15. Adaptive Measurement Network for CS Image Reconstruction10.1007/978-981-10-7302-1_34 ↗
16. Mousavi, A., Patel, A.B., and Baraniuk, R.G. (October, January 30). A deep learning approach to structured signal recovery. Proceedings of the 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton), Monticello, IL, USA.10.1109/ALLERTON.2015.7447163 ↗
17. Mousavi, A., and Baraniuk, R.G. (2017, January 5–9). Learning to invert: Signal recovery via Deep Convolutional Networks. Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, USA.10.1109/ICASSP.2017.7952561 ↗
18. Adaptive Super-Resolution Networks for Single-Pixel Imaging at Ultra-Low Sampling Rates10.1109/ACCESS.2024.3402693 ↗
19. Optimizing Under-Sampling in Fourier Single-Pixel imaging using GANs and attention mechanisms10.1016/j.optlastec.2025.112752 ↗
20. VGenNet: Variable Generative Prior Enhanced Single Pixel Imaging10.1021/acsphotonics.2c01537 ↗
21. Generative adversarial network with the discriminator using measurements as an auxiliary input for single-pixel imaging10.1016/j.optcom.2024.130485 ↗
22. Enhancing single-pixel imaging reconstruction using hybrid transformer network with adaptive feature refinement10.1364/OE.523276 ↗
23. Adaptive Coarse-to-Fine Single Pixel Imaging with Generative Adversarial Network Based Reconstruction10.1109/ACCESS.2023.3262165 ↗
24. High-resolution iterative reconstruction at extremely low sampling rate for Fourier single-pixel imaging via diffusion model10.1364/OE.510692 ↗
25. Diffusion Model with Gradient Descent Module Guiding Reconstruction for Single-Pixel Imaging
26. Enhanced Single Pixel Imaging by Using Adaptive Jointly Optimized Conditional Diffusion10.1109/TCI.2025.3544087 ↗
27. Multi-input mutual supervision network for single-pixel computational imaging10.1364/OE.510683 ↗
28. Single-pixel imaging using physics enhanced deep learning10.1364/PRJ.440123 ↗
29. Passive imaging through dense scattering media10.1364/PRJ.503451 ↗
30. Single-pixel imaging with untrained network using fourier transform at low sampling rates10.1016/j.optlaseng.2024.108764 ↗
31. Single-pixel imaging with untrained convolutional autoencoder network10.1016/j.optlastec.2023.109710 ↗
32. Far-field super-resolution ghost imaging with a deep neural network constraint10.1038/s41377-021-00680-w ↗
33. Low-sampling and noise-robust single-pixel imaging based on the untrained attention U-Net10.1364/OE.533458 ↗
34. Denoising Prior Driven Deep Neural Network for Image Restoration10.1109/TPAMI.2018.2873610 ↗
35. TDS-Net: Transformer enhanced dual-stream network for video Anomaly Detection10.1016/j.eswa.2024.124846 ↗
36. AD-Graph: Weakly Supervised Anomaly Detection Graph Neural Network10.1155/2023/7868415 ↗
37. Compressive sensing measurement matrix construction based on improved size compatible array LDPC code10.1049/iet-ipr.2015.0117 ↗
38. Soft threshold iteration-based anti-noise compressed sensing image reconstruction network10.1007/s11760-023-02686-w ↗
39. Enhancing single-pixel imaging by improving one-dimensional signal through encoded image similarity10.1016/j.optlastec.2025.112951 ↗
40. OIAE: Overall Improved Autoencoder with Powerful Image Reconstruction and Discriminative Feature Extraction10.1007/s12559-022-10000-y ↗
41. Zeng, H., Dong, J., Li, Q., Chen, W., Dong, S., Guo, H., and Wang, H. (2023). Compressive Reconstruction Based on Sparse Autoencoder Network Prior for Single-Pixel Imaging. Photonics, 10.10.3390/photonics10101109 ↗
42. High turbidity underwater single-pixel imaging based on Unet++ and attention mechanism at a low sampling10.1016/j.optcom.2023.130106 ↗
43. Signal recovery from random measurements via orthogonal matching pursuit10.1109/TIT.2007.909108 ↗
44. What Regularized Auto-Encoders Learn from the Data Generating Distribution
45. Highly undersampled magnetic resonance imaging reconstruction using autoencoding priors10.1002/mrm.27921 ↗
46. Multiplier and gradient methods10.1007/BF00927673 ↗
47. Linearized ADMM for Nonconvex Nonsmooth Optimization with Convergence Analysis10.1109/ACCESS.2019.2914461 ↗
48. Exponentiated gradient versus gradient descent for linear predictors10.1006/inco.1996.2612 ↗