Tone Mapping of High Dynamic Range Images Combining Co-Occurrence Histogram and Visual Salience Detection
Source abstract
Abstract
One of the significant qualities of the human vision, which differentiates it from computer vision, is so called attentional control, which is the innate ability of our human eyes to select what visual stimuli to pay attention to at any moment in time. In this sense, the visual salience detection model, which is designed to simulate how the human visual system (HVS) perceives objects and scenes, is widely used for performing multiple vision tasks. This model is also in high demand in the tone mapping technology of high dynamic range images (HDRIs). Another distinct quality of the HVS is that our eyes blink and adjust brightness when objects are in their sight. Likewise, HDR imaging is a technology applied to a camera that takes pictures of an object several times by repeatedly opening and closing a camera iris, which is referred to as multiple exposures. In this way, the computer vision is able to control brightness and depict a range of light intensities. HDRIs are the product of HDR imaging. This article proposes a novel tone mapping method using CCH-based saliency-aware weighting and edge-aware weighting methods to efficiently detect image salience information in the given HDRIs. The two weighting methods combine with a guided filter to generate a modified guided image filter (MGIF). The function of the MGIF is to split an image into the base layer and the detail layer which are the two elements of an image: illumination and reflection, respectively. The base layer is used to obtain global tone mapping and compress the dynamic range of HDRI while preserving the sharp edges of an object in the HDRI. This has a remarkable effect of reducing halos in the resulting HDRIs. The proposed approach in this article also has several distinct advantages of discriminative operation, tolerance to image size variation, and minimized parameter tuning. According to the experimental results, the proposed method has made progress compared to its existing counterparts when it comes to subjective and quantitative qualities, and color reproduction.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Visual Attention and Saliency Detection · Image Enhancement Techniques · Advanced Image Fusion Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Advanced Dental Device Development Institute, School of Dentistry, Kyungpook National University, 2177, Dalgubeol-daero, Jung-gu, Daegu 41940, Korea
School of Information and Communication Engineering, College of Electrical and Computer Engineering, Chungbuk National University, 1, Chungdae-ro, Seowon-gu, Cheongju-si, Chungcheongbuk-do 28644, Korea
School of Electronics Engineering, IT College, Kyungpook National University, 80, Daehak-ro, Buk-gu, Daegu 41566, Korea
References (31)
Show source-provided references
1. Reinhard, E., Heidrich, W., Debevec, P., Pattanaik, S., Ward, G., and Myszkwski, K. (2010). High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting, Morgan Kaufmann.
2. Yeganch, H., and Wang, Z. (2013). High Dynamic Range Image Tone Mapping by Maximizing a Structural Fidelity Measure, ICASSP.10.1109/ICASSP.2013.6637979 ↗
3. Objective quality assessment of tone-mapped images10.1109/TIP.2012.2221725 ↗
4. Tone mapping based HDR compression: Does it affect visual experience?10.1016/j.image.2013.09.005 ↗
5. Photographic Tone Reproduction for Digital Images10.1145/566654.566575 ↗
6. iCAM framework for image appearance, differences and quality10.1117/1.1635368 ↗
7. iCAM06: A refined image appearance model for HDR image rendering10.1016/j.jvcir.2007.06.003 ↗
8. Color saturation compensation in iCAM06 for high-chroma HDR image
9. Color correction for tone mapping10.1111/j.1467-8659.2009.01358.x ↗
10. Calibrated Image Appearance Reproduction10.1145/2366145.2366220 ↗
11. Modeling a color-rendering operator for high dynamic range images using a cone-response function10.1117/1.JEI.24.5.053005 ↗
12. Cyriac, P., Kane, D., and Bertalmio, M. (2016, January 14–18). Optimized Tone Curve for In-Camera Image Processing. Proceedings of the IS&T Electronic imaging Conference, San Francisco, CA, USA.
13. Hristova, H. (2017). Example-Guided Image Editing. [Ph.D. Thesis, University of Rennes].
14. Choi, H.-H., Kim, E.-S., and Yun, B.-J. (2019, January 2–5). Tone Mapping High Dynamic Range image using Cone Response Function based on CAM16. Proceedings of the 2019 Eleventh International Conference on Ubiquitous and Future Network (ICUFN), Zagreb, Croatia.10.1109/ICUFN.2019.8806090 ↗
15. Kinoshita, Y., Shiota, S., and Kiya, H. (2017, January 24–28). Reinhard’s global operator based inverse Tone mapping with one parameter. Proceedings of the 2017 Eighth International Workshop on Signal Design and Its Applications in Communications (IWSDA), Sapporo, Japan.10.1109/IWSDA.2017.8095734 ↗
16. Color appearance in high-dynamic-range imaging10.1117/1.2238891 ↗
17. The Quantitative Model for Optimal Threshold and Gamma of Display Using Brightness Function
18. Visual sensitivity correlated tone reproduction for low dynamic range images in the compression field10.1117/1.OE.53.11.113111 ↗
19. Robust and Efficient Saliency Modeling from Image Co-Occurrence Histogram10.1109/TPAMI.2013.158 ↗
20. Guided Image Filtering10.1109/TPAMI.2012.213 ↗
21. Region-of-Interest Extraction Based on Saliency Analysis of Co-Occurrence Histogram in High Spatial Resolution Remote Sensing Images10.1109/JSTARS.2015.2394241 ↗
22. On the (Boltzmann) entropy of non-equilibrium system10.1016/j.physd.2004.01.008 ↗
23. Weighted Guided Image Filtering10.1109/TIP.2014.2371234 ↗
24. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
25. A model of saliency-based visual attention for rapid scene analysis10.1109/34.730558 ↗
26. Hurvich, L.M., and Jameson, D. (1966). The Perception of Brightness and Darkness, Allyn & Bacon.
27. CMC 2000 chromatic adaptation transform: CMCCAT200010.1002/col.10005 ↗
28. ICC3D Version 1.2.9, (c) 2002–2003, Gjovik University College. 2002–2003.
29. Kang, H.R. (2006). Computational Color Technology, SPIE PRESS.10.1117/3.660835 ↗
30. Ohta, N., and Robertson, A.R. (2005). Colorimetry Fundamentals and Applications, Wiley.10.1002/0470094745 ↗
31. Morovic, J. (2008). Color Gamut Mapping, Wiley.10.1002/9780470758922 ↗