Ranking-preserving cross-source learning for image retargeting quality assessment

Liu, Yong-Jin, Han, Yiheng, Ye, Zipeng and Lai, Yu-kun ORCID: https://orcid.org/0000-0002-2094-5680 2020. Ranking-preserving cross-source learning for image retargeting quality assessment. IEEE Transactions on Pattern Analysis and Machine Intelligence 42 (7) , pp. 1798-1805. 10.1109/TPAMI.2019.2923998

Preview

PDF - Accepted Post-Print Version Download (12MB) | Preview

Abstract

Image retargeting techniques adjust images into different sizes and have attracted much attention recently. Objective quality assessment (OQA) of image retargeting results is often desired to automatically select the best results. Existing OQA methods train a model using some benchmarks (e.g., RetargetMe), in which subjective scores evaluated by users are provided. Observing that it is challenging even for human subjects to give consistent scores for retargeting results of different source images (diff-source-results), in this paper we propose a learning-based OQA method that trains a General Regression Neural Network (GRNN) model based on relative scores - which preserve the ranking - of retargeting results of the same source image (same-source-results). In particular, we develop a novel training scheme with provable convergence that learns a common base scalar for same-source-results. With this source specific offset, our computed scores not only preserve the ranking of subjective scores for same-source-results, but also provide a reference to compare the diff-source-results. We train and evaluate our GRNN model using human preference data collected in RetargetMe. We further introduce a subjective benchmark to evaluate the generalizability of different OQA methods. Experimental results demonstrate that our method outperforms ten representative OQA methods in ranking prediction and has better generalizability to different datasets.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	Institute of Electrical and Electronics Engineers (IEEE)
ISSN:	0162-8828
Funders:	The Royal Society
Date of First Compliant Deposit:	16 June 2019
Date of Acceptance:	11 June 2019
Last Modified:	07 Nov 2023 06:46
URI:	https://orca.cardiff.ac.uk/id/eprint/123472

Citation Data

Cited 4 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item