journal article·2022Open access

Use of Local Region Maps on Convolutional LSTM for Single-Image HDR Reconstruction

Seungwook Oh, GyeongIk Shin, Hyunki Hong

Computers, Materials & Continua· Volume 71· Issue 3

Abstract

Low dynamic range (LDR) images captured by consumer cameras have a limited luminance range. As the conventional method for generating high dynamic range (HDR) images involves merging multiple-exposure LDR images of the same scene (assuming a stationary scene), we introduce a learning-based model for single-image HDR reconstruction. An input LDR image is sequentially segmented into the local region maps based on the cumulative histogram of the input brightness distribution. Using the local region maps, SParam-Net estimates the parameters of an inverse tone mapping function to generate a pseudo-HDR image. We process the segmented region maps as the input sequences on long short-term memory. Finally, a fast super-resolution convolutional neural network is used for HDR image reconstruction. The proposed method was trained and tested on datasets including HDR-Real, LDR-HDR-pair, and HDR-Eye. The experimental results revealed that HDR images can be generated more reliably than using contemporary end-to-end approaches.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Image Enhancement Techniques · Advanced Vision and Imaging · Advanced Image Processing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (36)

Show source-provided references
1. A. Adams, The Camera (The Ansel Adams Photography Series). Little, Brown and Company, New York City, 1981.
2. Reinhard · High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting · 2010
3. Recovering high dynamic range radiance maps from photographs
4. High dynamic range imaging: Spatially varying pixel exposures
5. Fast high dynamic range image deghosting for abitrary scene motion
6. Ghost removal in high range images
7. Unified hdr reconstruction from raw cfa data
8. A versatile hdr video production system10.1145/2010324.1964936 ↗
9. Enhancement of bright video features for hdr displays10.1111/j.1467-8659.2008.01265.x ↗
10. Pseudo-multiple-exposure-based tone fusion with local region adjustment10.1109/TMM.2015.2403612 ↗
11. Inverse tone mapping
12. Hdr-vdp-2: A calibrated visual metric for visibility and quality predictions in all luminance conditions10.1145/2010324.1964935 ↗
13. Evaluation of reverse tone mapping through varying exposure conditions
14. High dynamic range image hallucination
15. Photographic tone reproduction for digital images10.1145/566654.566575 ↗
16. Ldr2hdr: On-the-fly reverse tone mapping of legacy video and photographs10.1145/1276377.1276426 ↗
17. Learning high dynamic range from outdoor panoramas
18. Expandnet: A deep convolutional neural network for high dynamic range expansion from low dynamic range content10.1111/cgf.13340 ↗
19. Deep reverse tone mapping10.1145/3130800.3130834 ↗
20. Dynamic range expansion using cumulative histogram learning for high dynamic range image generation10.1109/ACCESS.2020.2975857 ↗
21. Single-image hdr reconstruction by learning to reverse the camera pipeline
22. Hdr image reconstruction from a single exposure using deep cnns10.1145/3130800.3130816 ↗
23. HDRUnet: Single image hdr reconstruction with denoising and dequantization
24. Deep high dynamic range imaging of dynamic scenes10.1145/3072959.3073609 ↗
25. Very deep convolutional networks for large-scale image recognition
26. Loss functions for image restoration with neural networks10.1109/TCI.2016.2644865 ↗
27. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
28. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
29. Convolutional lstm network: A machine learning approach for precipitation nowcasting
30. U-Net: Convolutional networks for biomedical image segmentation
31. Super-resolution using convolutional neural networks without any checkerboard artifacts
32. Fixed smooth convolutional layer for avoiding checkerboard artifacts in cnns
33. Accelerating the super-resolution convolutional neural network
34. Visual attention in ldr and hdr images
35. Deep recursive hdri: Inverse tone mapping using generative adversarial networks
36. Dynamic range independent image quality assessment10.1145/1360612.1360668 ↗