An Image-Quality Assessment Algorithm for Solar Tone-Mapped Images Based on Visual Simulation
Source abstract
Abstract
To facilitate the display of solar images, captured solar images are often subjected to tone-mapping and enhancement. Accordingly, it is necessary to assess the quality of solar images before and after tone-mapping. However, there exist certain differences in human subjective perception under different ambient light intensities and when using different displays. Therefore, this paper proposes an image-quality assessment algorithm for solar tone-mapped images based on visual simulation. By effectively modeling the display characteristics model and the human visual system (HVS) model, the modeled images can reflect the perceptual effects of the human visual system under different ambient lighting conditions and display devices. Feeding modeled images into general image-quality assessment (IQA) metrics enables a better alignment with human visual perception. The proposed approach has been validated by two metrics: the solar IQA metric T based on the image power spectrum, and the IQA metric S based on the signal detection probability. We conducted subjective quality assessment experiments in a bright indoor environment with an ambient light intensity of 400 lux. By adjusting the display brightness, the Ambient Contrast Ratio (ACR) was controlled at 226.69 and 17.83, respectively. When the ACR was 226.69, the subjective Spearman Rank Correlation Coefficient (SRCC) of the T metric for the input before and after modeled increased by 1.83%, and that of the S metric by 5.44%. In addition, at an ACR of 17.83, the subjective SRCC of the metric T increased by 1.79%, while that of the metric S by 8.38%. We also conducted a regression test on the tone-mapping enhancement parameters using the metric S, and the test results demonstrated that the images generated from the metric with modeled image input yielded better visual effects.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Image Enhancement Techniques · Solar Radiation and Photovoltaics · Image and Video Quality Assessment
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
National Laboratory on Adaptive Optics, Chengdu 610209, China
Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu 610209, China
University of Chinese Academy of Sciences, Beijing 100049, China
Funding
National Natural Science Foundation of China
References (52)
Show source-provided references
1. EAST-Educational Adaptive-optics Solar Telescope10.1088/1674-4527/ac65e8 ↗
2. Ground-layer adaptive optics for the New Vacuum Solar Telescope: Instrument description and first results10.1007/s11433-022-2107-4 ↗
3. Astronomical adaptive optics: A review10.1186/s43074-024-00118-7 ↗
4. (2012). Methodology for the Subjective Assessment of the Quality of Television Pictures. Standard No. Recommendation ITU-R BT.500-13.
5. (2000). Subjective Assessment of Stereoscopic Television Pictures (Standard No. Recommendation ITU-R BT.1438).
6. The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation10.7717/peerj-cs.623 ↗
7. Statistical evaluation of image quality measures10.1117/1.1455011 ↗
8. Visible differences predictor: An algorithm for the assessment of image fidelity10.1117/12.135952 ↗
9. Watson, A.B. (1993). Digital Images and Human Vision, The MIT Press.
10. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
11. Image information and visual quality10.1109/TIP.2005.859378 ↗
12. No-reference image quality assessment in the spatial domain10.1109/TIP.2012.2214050 ↗
13. Blind image quality assessment: A natural scene statistics approach in the DCT domain10.1109/TIP.2012.2191563 ↗
14. Blind image quality assessment using joint statistics of gradient magnitude and Laplacian features10.1109/TIP.2014.2355716 ↗
15. Objective image quality measure derived from digital image power spectra10.1117/12.56114 ↗
16. Zhu, X., and Milanfar, P. (2009). A no-reference sharpness metric sensitive to blur and noise. Proceedings of the 2009 International Workshop on Quality of Multimedia Experience, San Diego, CA, USA, 29–31 July 2009, IEEE.10.1109/QOMEX.2009.5246976 ↗
17. A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB)10.1109/TIP.2008.2011760 ↗
18. A no-reference image blur metric based on the cumulative probability of blur detection (CPBD)10.1109/TIP.2011.2131660 ↗
19. A fast wavelet-based algorithm for global and local image sharpness estimation10.1109/LSP.2012.2199980 ↗
20. Image sharpness assessment based on local phase coherence10.1109/TIP.2013.2251643 ↗
21. Blind image quality assessment using a general regression neural network10.1109/TNN.2011.2120620 ↗
22. Kang, L., Ye, P., Li, Y., and Doermann, D. (2014, January 23–28). Convolutional neural networks for no-reference image quality assessment. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.10.1109/CVPR.2014.224 ↗
23. Lv, Y., Jiang, G., Yu, M., Xu, H., Shao, F., and Liu, S. (2015). Difference of Gaussian statistical features based blind image quality assessment: A deep learning approach. Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP), IEEE.10.1109/ICIP.2015.7351221 ↗
24. Fully deep blind image quality predictor10.1109/JSTSP.2016.2639328 ↗
25. DDcGAN: A dual-discriminator conditional generative adversarial network for multi-resolution image fusion10.1109/TIP.2020.2977573 ↗
26. Zeng, H., Zhang, L., and Bovik, A.C. (2018). Blind image quality assessment with a probabilistic quality representation. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece, 7–10 October 2018, IEEE.10.1109/ICIP.2018.8451285 ↗
27. Dynamic range independent image quality assessment10.1145/1360612.1360668 ↗
28. Objective quality assessment of tone-mapped images10.1109/TIP.2012.2221725 ↗
29. High dynamic range image compression by optimizing tone mapped image quality index10.1109/TIP.2015.2436340 ↗
30. FSITM: A feature similarity index for tone-mapped images10.1109/LSP.2014.2381458 ↗
31. Full-reference objective quality assessment of tone-mapped images10.1109/TMM.2017.2740023 ↗
32. FFTMI: Features fusion for natural tone-mapped images quality evaluation10.1109/TMM.2019.2952256 ↗
33. Blind quality assessment of tone-mapped images via analysis of information, naturalness, and structure10.1109/TMM.2016.2518868 ↗
34. No-reference quality assessment of tone-mapped HDR pictures10.1109/TIP.2017.2685941 ↗
35. Biologically inspired blind quality assessment of tone-mapped images10.1109/TIE.2017.2739708 ↗
36. Blind quality index for tone-mapped images based on luminance partition10.1016/j.patcog.2019.01.010 ↗
37. Blind quality assessment for tone-mapped images based on local and global features10.1016/j.ins.2020.03.067 ↗
38. Blind quality assessment for tone-mapped images by analysis of gradient and chromatic statistics10.1109/TMM.2020.2991528 ↗
39. Exploiting local degradation characteristics and global statistical properties for blind quality assessment of tone-mapped HDR images10.1109/TMM.2020.2986583 ↗
40. Kumar, V.A., Gupta, S., Chandra, S.S., Raman, S., and Channappayya, S.S. (2017). No-reference quality assessment of tone mapped high dynamic range (HDR) images using transfer learning. Proceedings of the 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), Erfurt, Germany, 31 May–2 June 2017, IEEE.10.1109/QoMEX.2017.7965668 ↗
41. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
42. Blind quality assessment of tone-mapped images using multi-exposure sequences10.1016/j.jvcir.2022.103553 ↗
43. Yang, M., Tian, Y., and Rao, C.H. (2018). Adaptive optics-corrected solar image quality assessment based on image power spectrum and human visual system. Opt. Eng., 57.10.1117/1.OE.57.1.013102 ↗
44. Mantiuk, R., Daly, S., and Kerofsky, L. (2008). Display adaptive tone mapping. ACM SIGGRAPH 2008 Papers, Association for Computing Machinery.10.1145/1399504.1360667 ↗
45. Ferwerda, J.A., Pattanaik, S.N., Shirley, P., and Greenberg, D.P. (1996). A model of visual adaptation for realistic image synthesis. Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, New Orleans, LA, USA, 4–9 August 1996, Association for Computing Machinery.10.1145/237170.237262 ↗
46. Ward, G. (1994). A contrast-based scalefactor for luminance display. Graphics Gems IV, Academic Press Professional, Inc.10.1016/B978-0-12-336156-1.50054-9 ↗
47. Optical interference, contrast-enhanced electroluminescent device10.1364/AO.31.005988 ↗
48. 5.3: Invited Paper: AH-IPS, Superb Display for Mobile Device
49. Green, D.M., and Swets, J.A. (1966). Signal Detection Theory and Psychophysics, Wiley.
50. JP Guilford. Psychometric Methods. New York: McGraw-Hill, 1954, pp. ix + 59710.1007/BF02288988 ↗
51. On the variability of critical illumination for flicker fusion and intensity discrimination10.1085/jgp.19.3.503 ↗
52. (2002). Methodology for the Subjective Assessment of the Quality of Television Pictures (Standard No. ITU-R BT.500-14).