Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

Ranking-preserving cross-source learning for image retargeting quality assessment

Liu, Yong-Jin, Han, Yiheng, Ye, Zipeng and Lai, Yukun 2020. Ranking-preserving cross-source learning for image retargeting quality assessment. IEEE Transactions on Pattern Analysis and Machine Intelligence 42 (7) , pp. 1798-1805. 10.1109/TPAMI.2019.2923998

[img]
Preview
PDF - Accepted Post-Print Version
Download (12MB) | Preview

Abstract

Image retargeting techniques adjust images into different sizes and have attracted much attention recently. Objective quality assessment (OQA) of image retargeting results is often desired to automatically select the best results. Existing OQA methods train a model using some benchmarks (e.g., RetargetMe), in which subjective scores evaluated by users are provided. Observing that it is challenging even for human subjects to give consistent scores for retargeting results of different source images (diff-source-results), in this paper we propose a learning-based OQA method that trains a General Regression Neural Network (GRNN) model based on relative scores - which preserve the ranking - of retargeting results of the same source image (same-source-results). In particular, we develop a novel training scheme with provable convergence that learns a common base scalar for same-source-results. With this source specific offset, our computed scores not only preserve the ranking of subjective scores for same-source-results, but also provide a reference to compare the diff-source-results. We train and evaluate our GRNN model using human preference data collected in RetargetMe. We further introduce a subjective benchmark to evaluate the generalizability of different OQA methods. Experimental results demonstrate that our method outperforms ten representative OQA methods in ranking prediction and has better generalizability to different datasets.

Item Type: Article
Date Type: Publication
Status: Published
Schools: Computer Science & Informatics
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
ISSN: 0162-8828
Funders: The Royal Society
Date of First Compliant Deposit: 16 June 2019
Date of Acceptance: 11 June 2019
Last Modified: 25 Nov 2020 12:09
URI: http://orca.cf.ac.uk/id/eprint/123472

Actions (repository staff only)

Edit Item Edit Item

Downloads

Downloads per month over past year

View more statistics