journal article·2020-09-09Open access

Infrared Image Adaptive Enhancement Guided by Energy of Gradient Transformation and Multiscale Image Fusion

Feiran Chen, Jianlin Zhang, Jingju Cai, Tao Xu, Gang Lu, Xianrong Peng

Applied Sciences· Volume 10· Issue 18

Abstract

The detail enhancement and dynamic range compression of infrared (IR) images is an important issue and a necessary practical application in the domain of IR image processing. This paper provides a novel approach to displaying high dynamic range infrared images on common display equipment with appropriate contrast and clear detail information. The steps are chiefly as follows. First, in order to protect the weak global details in different regions of the image, we adjust the original normalized image into multiple brightness levels by adaptive Gamma transformation. Second, each brightness image is decomposed into a base layer and several detail layers by the multiscale guided filter. Details in each image are enhanced separately. Third, to obtain the image with global details of the input image, enhanced images in each brightness are fused together. Last, we filter out the outliers and adjust the dynamic range before outputting the image. Compared with other conventional or cutting-edge methods, the experimental results demonstrate that the proposed approach is effective and robust in dynamic range compression and detail information enhancement of IR image.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Image Fusion Techniques · Image Enhancement Techniques · Photoacoustic and Ultrasonic Imaging

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Key Laboratory of Optical Engineering, Institute of Optics and Electronics, Chinese Academy of Sciences, No.1, Optoelectronic Avenue, Wenxing Town, Shuangliu District, Chengdu 610209, China

University of Chinese Academy of Sciences, Beijing 100039, China

Systems Engineering Research Institute, Beijing 100036, China

Funding

the National High Technology Research and Develop- 308 ment Program of China (863 Program)

References (35)

Show source-provided references
1. Sanchez-Reillo, R., Tamer, S., Lu, G., Duta, N., and Keck, M. (2009). Histogram Equalization, Springer.
2. New enhancement algorithm for infrared image based on double plateaus histogram
3. Plateau equalization algorithm for real-time display of high-quality infrared imagery10.1117/1.601006 ↗
4. A real-time contrast enhancement algorithm for infrared images based on plateau histogram
5. Zuiderveld, K. (1994). Contrast Limited Adaptive Histogram Equalization. Graphics Gems, Academic Press Professional, Inc.10.1016/B978-0-12-336156-1.50061-6 ↗
6. Wan, M., Gu, G., Qian, W., Ren, K., Chen, Q., and Maldague, X. (2018). Infrared Image Enhancement Using Adaptive Histogram Partition and Brightness Correction. Remote Sens., 10.10.3390/rs10050682 ↗
7. A new adaptive contrast enhancement algorithm for infrared images based on double plateaus histogram equalization10.1016/j.infrared.2012.03.004 ↗
8. An advanced contrast enhancement using partially overlapped sub-block histogram equalization10.1109/76.915354 ↗
9. Fattal, R., Lischinski, D., and Werman, M. (2002). Gradient Domain High Dynamic Range Compression. ACM Trans. Graph., 21.10.1145/566654.566573 ↗
10. High dynamic range compression and detail enhancement of infrared images in the gradient domain10.1016/j.infrared.2014.09.003 ↗
11. Fast bilateral filtering for the display of high-dynamic-range images10.1145/566654.566574 ↗
12. Guided Image Filtering10.1109/TPAMI.2012.213 ↗
13. Image Fusion With Guided Filtering10.1109/TIP.2013.2244222 ↗
14. Local Edge-Preserving Multiscale Decomposition for High Dynamic Range Image Tone Mapping10.1109/TIP.2012.2214047 ↗
15. Image enhancement using multi scale image features extracted by top-hat transform10.1016/j.optlastec.2011.07.009 ↗
16. Infrared image enhancement through contrast enhancement by using multiscale new top-hat transform10.1016/j.infrared.2010.12.001 ↗
17. Zhan, B., and Wu, Y. (2010, January 26–28). Infrared Image Enhancement Based on Wavelet Transformation and Retinex. Proceedings of the 2010 Second International Conference on Intelligent Human-machine Systems & Cybernetics, Nanjing, China.10.1109/IHMSC.2010.84 ↗
18. Lightness and retinex theory
19. The Retinex Theory of Color Vision10.1038/scientificamerican1277-108 ↗
20. Retinex processing for automatic image enhancement10.1117/1.1636183 ↗
21. Pu, Y.F., Zhang, N., Wang, Z.N., Wang, J., Yi, Z., Wang, Y., and Zhou, J.L. (2019). Fractional-Order Retinex for Adaptive Contrast Enhancement of Under-Exposed Traffic Images. IEEE Intell. Transp. Syst. Mag.
22. Properties and performance of a center/surround retinex10.1109/83.557356 ↗
23. Rahman, Z., Jobson, D.J., and Woodell, G.A. (2002, January 19). Multi-scale retinex for color image enhancement. Proceedings of the 3rd IEEE International Conference on Image Processing, Lausanne, Switzerland.10.1109/ICIP.1996.560995 ↗
24. Photographic tone reproduction for digital images10.1145/566654.566575 ↗
25. Calibrated image appearance reproduction10.1145/2366145.2366220 ↗
26. Perceptual Lightness Modeling for High Dynamic Range Imaging10.1145/3086577 ↗
27. Infrared and visible image fusion based on visual saliency map and weighted least square optimization10.1016/j.infrared.2017.02.005 ↗
28. Infrared and visible image fusion using fuzzy logic and population-based optimization10.1016/j.asoc.2011.11.020 ↗
29. Ma, K., and Zhou, W. (2015, January 27–30). Multi-exposure image fusion: A patch-wise approach. Proceedings of the 2015 IEEE International Conference on Image Processing, Quebec City, QC, Canada.10.1109/ICIP.2015.7351094 ↗
30. Robust Multi-Exposure Image Fusion: A Structural Patch Decomposition Approach10.1109/TIP.2017.2671921 ↗
31. (2019, August 16). FLIR Thermal Starter Dataset Version 1.3. Available online: https://www.flir.com/oem/adas/adas-dataset-form/.
32. Berg, A., Ahlberg, J., and Felsberg, M. (2015, January 25–28). A Thermal Object Tracking Benchmark. Proceedings of the 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Karlsruhe, Germany.10.1109/AVSS.2015.7301772 ↗
33. Tenenbaum, J.M. (1971). Accommodation in Computer Vision, Computer Science Department, Stanford University.
34. Making a “completely blind” image quality analyzer10.1109/LSP.2012.2227726 ↗
35. Venkatanath, N., Praneeth, D., Bh, M.C., Channappayya, S.S., and Medasani, S.S. (March, January 27). Blind image quality evaluation using perception based features. Proceedings of the 2015 Twenty First National Conference on Communications (NCC), Mumbai, India.10.1109/NCC.2015.7084843 ↗