Comfort-driven disparity adjustment for stereoscopic video

Wang, Miao, Zhang, Xi-Jin, Liang, Jun-Bang, Zhang, Song-Hai and Martin, Ralph Robert 2016. Comfort-driven disparity adjustment for stereoscopic video. Computational Visual Media 2 (1) , pp. 3-17. 10.1007/s41095-016-0037-5

Preview

PDF - Accepted Post-Print Version Download (4MB) | Preview

Abstract

Pixel disparity—the offset of corresponding pixels between left and right views—is a crucial parameter in stereoscopic three-dimensional (S3D) video, as it determines the depth perceived by the human visual system (HVS). Unsuitable pixel disparity distribution throughout an S3D video may lead to visual discomfort. We present a unified and extensible stereoscopic video disparity adjustment framework which improves the viewing experience for an S3D video by keeping the perceived 3D appearance as unchanged as possible while minimizing discomfort. We first analyse disparity and motion attributes of S3D video in general, then derive a wide-ranging visual discomfort metric from existing perceptual comfort models. An objective function based on this metric is used as the basis of a hierarchical optimisation method to find a disparity mapping function for each input video frame. Warping-based disparity manipulation is then applied to the input video to generate the output video, using the desired disparity mappings as constraints. Our comfort metric takes into account disparity range, motion, and stereoscopic window violation; the framework could easily be extended to use further visual comfort models. We demonstrate the power of our approach using both animated cartoons and real S3D videos.

Item Type:	Article
Date Type:	Published Online
Status:	Published
Schools:	Computer Science & Informatics
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Additional Information:	PDF uploaded in accordance with the Publisher's policies at http://www.sherpa.ac.uk/romeo/issn/2096-0433/ (accessed 10/03/16).
Publisher:	Springer
ISSN:	2096-0433
Date of First Compliant Deposit:	30 March 2016
Date of Acceptance:	9 December 2015
Last Modified:	08 May 2023 05:41
URI:	https://orca.cardiff.ac.uk/id/eprint/87639

Citation Data

Cited 14 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item