journal article·2023-07-28Open access

Full-Reference Image Quality Assessment Based on Multi-Channel Visual Information Fusion

Benchi Jiang, Shilei Bian, Chenyang Shi, Lulu Wu

Applied Sciences· Volume 13· Issue 15

Abstract

This study focuses on improving the objective alignment of image quality assessment (IQA) algorithms with human visual perception. Existing methodologies, predominantly those based on the Laplacian of Gaussian (LoG) filter, often neglect the impact of color channels on human visual perception. Consequently, we propose a full-reference IQA method that integrates multi-channel visual information in color images. The methodology begins with converting red, green, blue (RGB) images into the luminance (L), red–green opponent color channel (M), blue–yellow opponent color channel (N) or LMN color space. Subsequently, the LoG filter is separately applied to the L, M, and N channels. The convoluted components are then fused to generate a contrast similarity map using the root-mean-square method, while the chromaticity similarity map is derived from the color channels. Finally, multi-channel LoG filtering, contrast, and chromaticity image features are connected. The standard deviation method is then used for sum pooling to create a full-reference IQA computational method. To validate the proposed method, distorted images from four widely used image databases were tested. The evaluation, based on four criteria, focused on the method’s prediction accuracy, computational complexity, and generalizability. The Pearson linear correlation coefficient (PLCC) values, recorded from the databases, ranged from 0.8822 (TID2013) to 0.9754 (LIVE). Similarly, the Spearman rank-order correlation coefficient (SROCC) values spanned from 0.8606 (TID2013) to 0.9798 (LIVE). In comparison to existing methods, the proposed IQA method exhibited superior visual correlation prediction accuracy, indicating its promising potential in the field of image quality assessment.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Image and Video Quality Assessment · Advanced Image Fusion Techniques · Color Science and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Artificial Intelligence, Anhui Polytechnic University, Wuhu 241000, China

Industry Innovation Technology Research Co., Ltd., Anhui Polytechnic University, Wuhu 241000, China

Funding

National Natural Science Foundation of China · Key Project of Scientific Research in universities of Anhui Province · Research Start-up Foundation for Introduction of Talents of AHPU · Scientific Research Fund of AHPU · Enterprise Cooperation Project of Anhui Future Technology Research Institute

References (46)

Show source-provided references
1. Shi, C.Y., and Lin, Y.D. (2022). Image Quality Assessment Based on Three Features Fusion in Three Fusion Steps. Symmetry, 14.10.3390/sym14040773 ↗
2. Full reference image quality assessment based on color appearance-based phase consistency10.37188/OPE.20233110.1509 ↗
3. Full reference image quality assessment based on visual salience with color appearance and gradient similarity10.1109/ACCESS.2020.2995420 ↗
4. Wei, L., Zhao, L., and Peng, J. (2021). Reduced Reference Quality Assessment for Image Retargeting by Earth Mover’s Distance. Appl. Sci., 11.10.3390/app11209776 ↗
5. No Reference Image Sharpness Assessment Based on Global Color Difference Variation
6. Shen, T.W., Li, C.C., Lin, W.F., Tseng, Y.H., Wu, W.F., Wu, S., Tseng, Z.L., and Hsu, M.H. (2022). Improving Image Quality Assessment Based on the Combination of the Power Spectrum of Fingerprint Images and Prewitt Filter. Appl. Sci., 12.10.3390/app12073320 ↗
7. Superpixel and Visual Saliency Synergetic Image Quality Assessment
8. A reversible information hiding algorithm in AMBTC domain based on human vision system10.1088/1742-6596/1982/1/012071 ↗
9. Image Quality Assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
10. Michelson contrast, RMS contrast and energy of various spatial stimuli at threshold10.1016/0042-6989(93)90049-3 ↗
11. Three-component weighted structural similarity index
12. Contrast and Visual Saliency Similarity-induced Index for Assessing Image Quality10.1109/ACCESS.2018.2878739 ↗
13. Image Quality Assessment Based on Gradient Similarity
14. Image information and visual quality10.1109/TIP.2005.859378 ↗
15. The Gaussian derivative model for spatial vision: I. Retinal mechanisms10.1163/156856887X00222 ↗
16. FSIM: A Feature Similarity Index for Image Quality Assessment10.1109/TIP.2011.2109730 ↗
17. VSI: A visual saliency-induced index for perceptual image quality assessment10.1109/TIP.2014.2346028 ↗
18. Temel, D., and Alregib, G. (2015, January 27–30). PerSIM: Multi-resolution image quality assessment in the perceptually uniform color domain. Proceedings of the IEEE International Conference on Image Processing, Quebec City, QC, Canada.10.1109/ICIP.2015.7351087 ↗
19. Application of machine learning in intelligent encryption for digital information of real-time image text under big data10.1186/s13638-022-02111-9 ↗
20. DeepSim: Deep similarity for image quality assessment10.1016/j.neucom.2017.01.054 ↗
21. Deep learning of full-reference image quality assessment based on human visual properties10.3788/IRLA201847.0703004 ↗
22. Image quality assessment using human visual DoG Model Fused with Random Forest10.1109/TIP.2015.2440172 ↗
23. Diplq: Blind image quality assessment by learning-to-rank discriminable image pairs10.1109/TIP.2017.2708503 ↗
24. Deep CNN-Based blind Image quality predictor10.1109/TNNLS.2018.2829819 ↗
25. Quality based approach for adaptive face recognition
26. Biometric templates selection and update using quality measures
27. Image quality guided approach for adaptive modelling of biometric intra-class variations
28. Contrast-distorted image quality assessment based on curvelet domain features
29. Full reference image quality assessment by considering intra-block structure and inter-block texture10.1109/ACCESS.2020.3028282 ↗
30. The contrast sensitivity of retinal ganglion cells of the cat10.1113/jphysiol.1966.sp008107 ↗
31. Extending CIELAB: Vividness Vab*, depth, Dab*, and clarity, Tab*10.1002/col.21833 ↗
32. Color Invariance10.1109/34.977559 ↗
33. Efficient gamut clipping for color image processing using LHS and YIQ10.1117/1.1544479 ↗
34. Wen, X., Pan, Z., and Hu, Y. (2021). Generative Adversarial Learning in YUV Color Space for Thin Cloud Removal on Satellite Imagery. Remote Sens., 13.10.3390/rs13061079 ↗
35. TID2008—A Database for Evaluation of Full-Reference Visual Quality Assessment Metrics
36. Image quality assessment via colour information fluctuation10.1007/s11760-022-02323-y ↗
37. Statistical estimation of the structural similarity index for image quality assessment10.1007/s11760-021-02051-9 ↗
38. ASSP: An adaptive sample statistics-based pooling for full-reference image quality assessment10.1016/j.neucom.2021.12.098 ↗
39. RVSIM: A feature similarity method for full-reference image quality assessment10.1186/s13640-018-0246-1 ↗
40. Most apparent distortion: Full-reference image quality assessment and the role of strategy10.1117/1.3267105 ↗
41. Gradient magnitude similarity deviation: A highly efficient perceptual image quality index10.1109/TIP.2013.2293423 ↗
42. Objective image quality assessment based on image color appearance and gradient features10.7498/aps.69.20200753 ↗
43. Image quality assessment: Unifying structure and texture similarity
44. Varga, D. (2022). Saliency-Guided Local Full-Reference Image Quality Assessment. Signals, 3.10.3390/signals3030028 ↗
45. Full Reference Image Quality Assessment Based on Visual Saliency and Perception Similarity Index
46. Varga, D. (2022). Full-Reference Image Quality Assessment Based on Grünwald–Letnikov Derivative, Image Gradients, and Visual Saliency. Electronics, 11.10.3390/electronics11040559 ↗