journal article·2023Open access

RF-Net: Unsupervised Low-Light Image Enhancement Based on Retinex and Exposure Fusion

Tian Ma, Chenhui Fu, Jiayi Yang, Jiehui Zhang, Chuyang Shang

Computers, Materials & Continua· Volume 77· Issue 1

Abstract

Low-light image enhancement methods have limitations in addressing issues such as color distortion, lack of vibrancy, and uneven light distribution and often require paired training data. To address these issues, we propose a two-stage unsupervised low-light image enhancement algorithm called Retinex and Exposure Fusion Network (RF-Net), which can overcome the problems of over-enhancement of the high dynamic range and under-enhancement of the low dynamic range in existing enhancement algorithms. This algorithm can better manage the challenges brought about by complex environments in real-world scenarios by training with unpaired low-light images and regular-light images. In the first stage, we design a multi-scale feature extraction module based on Retinex theory, capable of extracting details and structural information at different scales to generate high-quality illumination and reflection images. In the second stage, an exposure image generator is designed through the camera response mechanism function to acquire exposure images containing more dark features, and the generated images are fused with the original input images to complete the low-light image enhancement. Experiments show the effectiveness and rationality of each module designed in this paper. And the method reconstructs the details of contrast and color distribution, outperforms the current state-of-the-art methods in both qualitative and quantitative metrics, and shows excellent performance in the real world.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Image Enhancement Techniques · Advanced Image Fusion Techniques · Advanced Image Processing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (40)

Show source-provided references
1. Properties and performance of a center/surround retinex10.1109/83.557356 ↗
2. Multi-scale retinex for color image enhancement
3. A multiscale retinex for bridging the gap between color images and the human observation of scenes10.1109/83.597272 ↗
4. EnlightenGAN: Deep light enhancement without paired supervision10.1109/TIP.2021.3051462 ↗
5. Zero-reference deep curve estimation for low-light image enhancement
6. Contrast enhancement using brightness preserving bi-histogram equalization10.1109/30.580378 ↗
7. Image enhancement based on equal area dualistic sub-image histogram equalization method10.1109/30.754419 ↗
8. Adaptive contrast enhancement based on histogram modification framework10.1080/09500340.2019.1649482 ↗
9. The retinex theory of color vision10.1038/scientificamerican1277-108 ↗
10. LIME: Low-light image enhancement via illumination map estimation10.1109/TIP.2016.2639450 ↗
11. C. Wei, W. Wang, W. Yang and J. Liu, “Deep retinex decomposition for low-light enhancement,” arXiv preprint arXiv:1808.04560, 2018.
12. Kindling the darkness: A practical low-light image enhancer
13. Beyond brightening low-light images10.1007/s11263-020-01407-x ↗
14. Gladnet: Low-light enhancement network with global awareness
15. Low-light image enhancement with normalizing flow10.1609/aaai.v36i3.20162 ↗
16. Toward fast, flexible, and robust low-light image enhancement
17. Dual attention unit-based generative adversarial networks for low-light image enhancement
18. TPE: Lightweight transformer photo enhancement based on curve adjustment10.1109/ACCESS.2022.3191416 ↗
19. URetinex-Net: Retinex-based deep unfolding network for low-light image enhancement
20. Z. Cui, K. Li, L. Gu, S. Su, P. Gao et al., “Illumination Adaptive Transformer,” arXiv preprint arXiv:2205.14871, 2022.
21. From fidelity to perceptual quality: A semi-supervised approach for low-light image enhancement
22. Band representation-based semi-supervised low-light image enhancement: Bridging the gap between signal fidelity and perceptual quality10.1109/TIP.2021.3062184 ↗
23. Zero-shot restoration of back-lit images using deep internal learning
24. LE-GAN: Unsupervised low-light image enhancement network using attention module and identity invariant loss10.1016/j.knosys.2021.108010 ↗
25. Learning to enhance low-light image via zero-reference deep curve estimation
26. RetinexGAN: Unsupervised low-light enhancement with two-layer convolutional decomposition networks10.1109/ACCESS.2021.3072331 ↗
27. Zero-shot restoration of underexposed images via robust retinex decomposition
28. Retinex-inspired unrolling with cooperative prior architecture search for low-light image enhancement
29. RetinexDIP: A unified deep framework for low-light image enhancement10.1109/TCSVT.2021.3073371 ↗
30. Coordinate attention for efficient mobile network design
31. Deep coupled feedback network for joint exposure fusion and image super-resolution10.1109/TIP.2021.3058764 ↗
32. Z. Ying, G. Li and W. Gao, “A bio-inspired multi-exposure fusion framework for low-light image enhancement,” arXiv preprint arXiv:1711. 00591, 2017.
33. Least squares generative adversarial networks
34. Naturalness preserved enhancement algorithm for non-uniform illumination images10.1109/TIP.2013.2261309 ↗
35. Contrast enhancement based on layered difference representation
36. Perceptual quality assessment for multi-exposure image fusion10.1109/TIP.2015.2442920 ↗
37. Making a “completely blind image quality analyzer10.1109/LSP.2012.2227726 ↗
38. No-reference image quality assessment in the spatial domain10.1109/TIP.2012.2214050 ↗
39. Going deeper with convolutions
40. Deep residual learning for image recognition