journal article·2021-10-19Open access

Reduced Reference Quality Assessment for Image Retargeting by Earth Mover’s Distance

Longsheng Wei, Lei Zhao, Jian Peng

Applied Sciences· Volume 11· Issue 20

Abstract

A reduced reference quality assessment algorithm for image retargeting by earth mover’s distance is proposed in this paper. In the reference image, all the feature points are extracted using scale invariant feature transform. Let the histograms of image patch around each feature point be local information, and the histograms of saliency feature as global information. Those feature information is extracted at the sender side and transmitted to the receiver side. After that, the same feature information extraction process is performed for the retargeted image at the receiver side. Finally, all feature information of the reference and retargeted images is used collectively to compute the quality of the retargeted image. An overall quality score is calculated from the local and global similarity measure using earth mover’s distance between reference and retargeted images. The key step in our algorithm is to provide an earth mover’s distance metric in a manner that indicates how the local and global information in the reference image is preserved in corresponding retargeted image. Experimental results show that the proposed algorithm can improve the image quality scores on four common criteria in the retargeted image quality assessment community.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Visual Attention and Saliency Detection · Image and Video Quality Assessment · Advanced Image and Video Retrieval Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Automation, China University of Geosciences, Wuhan 430074, China

Key Laboratory of Geological Survey and Evaluation of Ministry of Education, Wuhan 430074, China

Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems, Wuhan 430074, China

Funding

National Natural Science Foundation of China

References (24)

Show source-provided references
1. Image Quality Assessment Using Kernel Sparse Coding10.1109/TMM.2020.3001472 ↗
2. Reduced-Reference Image Quality Assessment in Free-Energy Principle and Sparse Representation10.1109/TMM.2017.2729020 ↗
3. A Comparative Study of Image Retargeting10.1145/1882261.1866186 ↗
4. Reduced-Reference Image Quality Assessment Using Reorganized DCT-Based Image Representation10.1109/TMM.2011.2109701 ↗
5. Reduced-Reference Image Quality Assessment With Visual Information Fidelity10.1109/TMM.2013.2266093 ↗
6. Reduced-Reference Image Quality Assessment Using Divisive Normalization-Based Image Representation10.1109/JSTSP.2009.2014497 ↗
7. RRED Indices: Reduced Reference Entropic Differencing for Image Quality Assessment10.1109/TIP.2011.2166082 ↗
8. Reduced-Reference Image Quality Assessment by Structural Similarity Estimation10.1109/TIP.2012.2197011 ↗
9. SpEED-QA: Spatial Efficient Entropic Differencing for Image and Video Quality10.1109/LSP.2017.2726542 ↗
10. Saliency-induced reduced-reference quality index for natural scene and screen content images10.1016/j.sigpro.2017.10.025 ↗
11. The Earth Mover’s Distance as a Metric for Image Retrieval10.1023/A:1026543900054 ↗
12. An Efficient Earth Mover’s Distance Algorithm for Robust Histogram Comparison10.1109/TPAMI.2007.1058 ↗
13. A Visual-Attention Model Using Earth Mover’s Distance-Based Saliency Measurement and Nonlinear Feature Combination10.1109/TPAMI.2012.119 ↗
14. Levina, E., and Bickel, P. (2001, January 7–14). The Earth Mover’s distance is the Mallows distance: Some insights from statistics. Proceedings of the Eighth IEEE International Conference on Computer Vision (ICCV), Vancouver, BC, Canada.
15. Robust L2E Estimation of Transformation for Non-Rigid Registration10.1109/TSP.2014.2388434 ↗
16. SIFT Flow: Dense Correspondence across Scenes and Its Applications10.1109/TPAMI.2010.147 ↗
17. Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index10.1109/TIP.2013.2293423 ↗
18. Baluch, F., and Itti, L. (2015). Mining videos for features that drive attention. Multimedia Data Mining and Analytics, Springer.10.1007/978-3-319-14998-1_14 ↗
19. A biologically inspired computational approach to model top-down and bottom-up visual attention10.1016/j.ijleo.2015.01.004 ↗
20. Ponomarenko, N., Jin, L., Ieremeiev, O., Lukin, V., Egiazarian, K., Astola, J., Vozel, B., Chehdi, K., Carli, M., and Battisti, F. (August, January 31). Image database TID2013: Peculiarities, results and perspectives. Proceedings of the Signal Processing: Image Communication, Bellingham, WA, USA.
21. Lin, H., Hosu, V., and Saupe, D. (2019, January 5–7). KADID-10k: A Large-scale Artificially Distorted IQA Database. Proceedings of the 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX), Berlin, Germany.10.1109/QoMEX.2019.8743252 ↗
22. CID2013: A database for evaluating noreference image quality assessment algorithms10.1109/TIP.2014.2378061 ↗
23. Massive Online Crowdsourced Study of Subjective and Objective Picture Quality10.1109/TIP.2015.2500021 ↗
24. Lin, H., Hosu, V., and Saupe, D. (2018). Koniq-10k: Towards an ecologically valid and large-scale iqa database, Pittsburgh, Pennsylvania. arXiv.