Two-Stage Denoising Diffusion Model for Low-Light Image Enhancement
Source abstract
Abstract
Images captured under weak illumination typically suffer from low brightness and contrast, severe color distortion, and significant noise contamination, which not only degrade human visual perception but also hinder the performance of high-level vision tasks. Low-light image enhancement aims to improve visual quality and provide favorable conditions for subsequent image processing. To address the challenges of non-uniform illumination and loss of details in dark regions, we propose a two-stage denoising diffusion model (two-stage DDM). Specifically, we design a convolution-based Retinex decomposition module to achieve fast and robust image decomposition, followed by a two-stage diffusion-based denoising process that further enhances global image details, brightness, and contrast. In addition, we introduce a feature enhancement module to strengthen the representational capacity of the reflectance component. To evaluate the robustness and generalization ability of the proposed model, extensive experiments are conducted on the LOLv1, LOLv2-real, and LSRW datasets. Experimental results demonstrate that the proposed two-stage DDM achieves competitive performance with state-of-the-art methods, producing enhanced images with more natural and spatially uniform brightness, along with noticeably improved visual quality.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Image Enhancement Techniques · Advanced Image Processing Techniques · Generative Adversarial Networks and Image Synthesis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mathematics and Physics, China University of Geosciences, Wuhan 430079, China
School of Computer Science, China University of Geosciences, Wuhan 430079, China
References (39)
Show source-provided references
1. Object detection in 20 years: A survey10.1109/JPROC.2023.3238524 ↗
2. Adjabi, I., Ouahabi, A., Benzaoui, A., and Taleb-Ahmed, A. (2020). Past, present, and future of face recognition: A review. Electronics, 9.10.20944/preprints202007.0479.v1 ↗
3. Tian, Z., Qu, P., Li, J., Sun, Y., Li, G., Liang, Z., and Zhang, W. (2023). A survey of deep learning-based low-light image enhancement. Sensors, 23.10.3390/s23187763 ↗
4. Illuminant and device invariant colour using histogram equalisation10.1016/j.patcog.2004.04.010 ↗
5. Adaptive histogram equalization and its variations10.1016/S0734-189X(87)80186-X ↗
6. Pizer, S.M. (1990, January 22–25). Contrast-limited adaptive histogram equalization: Speed and effectiveness stephen m. pizer, r. eugene johnston, james p. ericksen, bonnie c. yankaskas, keith e. muller medical image display research group. Proceedings of the First Conference on Visualization in Biomedical Computing, Atlanta, GA, USA.
7. Contrast enhancement using brightness preserving bi-histogram equalization10.1109/30.580378 ↗
8. Brightness preserving dynamic histogram equalization for image contrast enhancement10.1109/TCE.2007.4429280 ↗
9. Enhancement of low exposure images via recursive histogram equalization algorithms10.1016/j.ijleo.2015.06.060 ↗
10. Adaptive Image Enhancement Using Entropy-Based Subhistogram Equalization10.1155/2018/3837275 ↗
11. Liu, C., Sui, X., Kuang, X., Liu, Y., Gu, G., and Chen, Q. (2019). Adaptive contrast enhancement for infrared images based on the neighborhood conditional histogram. Remote Sens., 11.10.3390/rs11111381 ↗
12. Edge-enhancing bi-histogram equalisation using guided image filter10.1016/j.jvcir.2018.12.037 ↗
13. Denoising diffusion probabilistic models
14. Lightness and retinex theory10.1364/JOSA.61.000001 ↗
15. Properties and performance of a center/surround retinex10.1109/83.557356 ↗
16. A multiscale retinex for bridging the gap between color images and the human observation of scenes10.1109/83.597272 ↗
17. Multi-scale retinex with color restoration image enhancement based on Gaussian filtering and guided filtering10.1142/S0217979217440775 ↗
18. LLNet: A deep autoencoder approach to natural low-light image enhancement10.1016/j.patcog.2016.06.008 ↗
19. Wei, C., Wang, W., Yang, W., and Liu, J. (2018). Deep retinex decomposition for low-light enhancement. arXiv.
20. Zhang, L., Zhang, L., Liu, X., Shen, Y., Zhang, S., and Zhao, S. (2019, January 21–25). Zero-shot restoration of back-lit images using deep internal learning. Proceedings of the 27th ACM International Conference on Multimedia, Nice, France.10.1145/3343031.3351069 ↗
21. Zhu, A., Zhang, L., Shen, Y., Ma, Y., Zhao, S., and Zhou, Y. (2020, January 6–10). Zero-shot restoration of underexposed images via robust retinex decomposition. Proceedings of the 2020 IEEE International Conference on Multimedia and Expo (ICME), London, UK.10.1109/ICME46284.2020.9102962 ↗
22. Cai, Y., Bian, H., Lin, J., Wang, H., Timofte, R., and Zhang, Y. (2023, January 2–3). Retinexformer: One-stage retinex-based transformer for low-light image enhancement. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.01149 ↗
23. Nichol, A.Q., and Dhariwal, P. (2021, January 18–24). Improved denoising diffusion probabilistic models. Proceedings of the International Conference on Machine Learning, Virtual.
24. Bao, F., Li, C., Zhu, J., and Zhang, B. (2022). Analytic-dpm: An analytic estimate of the optimal reverse variance in diffusion probabilistic models. arXiv.
25. Maximum likelihood training of score-based diffusion models
26. Yi, X., Xu, H., Zhang, H., Tang, L., and Ma, J. (2023, January 2–3). Diff-retinex: Rethinking low-light image enhancement with a generative diffusion model. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.01130 ↗
27. He, C., Fang, C., Zhang, Y., Ye, T., Li, K., Tang, L., Guo, Z., Li, X., and Farsiu, S. (2023). Reti-diff: Illumination degradation image restoration with retinex-based latent diffusion model. arXiv.
28. Zhou, D., Yang, Z., and Yang, Y. (2023, January 19–25). Pyramid diffusion models for low-light image enhancement. Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, Macao, China.10.24963/ijcai.2023/199 ↗
29. Low-light image enhancement with wavelet-based diffusion models
30. Dldiff: Image detail-guided latent diffusion model for low-light image enhancement10.1109/LSP.2024.3453120 ↗
31. Chen, T., and Liu, D. (2024, January 23–25). Low light image enhancement based on Retinex theory and diffusion model. Proceedings of the 2024 8th International Conference on Digital Signal Processing, Hangzhou, China.10.1145/3653876.3653908 ↗
32. Jiang, H., Luo, A., Liu, X., Han, S., and Liu, S. (October, January 29). Lightendiffusion: Unsupervised low-light image enhancement with latent-retinex diffusion models. Proceedings of the European Conference on Computer Vision, Milan, Italy.
33. Chollet, F. (2017, January 21–26). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
34. Yu, F., Koltun, V., and Funkhouser, T. (2017, January 21–26). Dilated residual networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.75 ↗
35. Yang, W., Wang, S., Fang, Y., Wang, Y., and Liu, J. (2020, January 14–19). From fidelity to perceptual quality: A semi-supervised approach for low-light image enhancement. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00313 ↗
36. R2rnet: Low-light image enhancement via real-low to real-normal network10.1016/j.jvcir.2022.103712 ↗
37. Wu, W., Weng, J., Zhang, P., Wang, X., Yang, W., and Jiang, J. (2022, January 18–24). Uretinex-net: Retinex-based deep unfolding network for low-light image enhancement. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00581 ↗
38. Guo, C., Li, C., Guo, J., Loy, C.C., Hou, J., Kwong, S., and Cong, R. (2020, January 14–19). Zero-reference deep curve estimation for low-light image enhancement. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00185 ↗
39. Image intrinsic components guided conditional diffusion model for low-light image enhancement10.1109/TCSVT.2024.3441713 ↗