SPA: Sparse Photorealistic Animation using a single RGB-D camera

Li, Kun, Yang, Jingyu, Liu, Leijie, Boulic, Ronan, Lai, Yukun ORCID: https://orcid.org/0000-0002-2094-5680, Liu, Yebin, Li, Yubin and Molla, Eray 2016. SPA: Sparse Photorealistic Animation using a single RGB-D camera. IEEE Transactions on Circuits and Systems for Video Technology 27 (4) , pp. 771-783. 10.1109/TCSVT.2016.2556419

Preview

PDF - Published Version Available under License Creative Commons Attribution. Download (9MB) | Preview

Abstract

Photorealistic animation is a desirable technique for computer games and movie production. We propose a new method to synthesize plausible videos of human actors with new motions using a single cheap RGB-D camera. A small database is captured in a usual office environment, which happens only once for synthesizing different motions. We propose a markerless performance capture method using sparse deformation to obtain the geometry and pose of the actor for each time instance in the database. Then, we synthesize an animation video of the actor performing the new motion that is defined by the user. An adaptive model-guided texture synthesis method based on weighted low-rank matrix completion is proposed to be less sensitive to noise and outliers, which enables us to easily create photorealistic animation videos with new motions that are different from the motions in the database. Experimental results on the public dataset and our captured dataset have verified the effectiveness of the proposed method.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Additional Information:	Post Print uploaded in accordance with publisher's policy at http://www.sherpa.ac.uk/romeo/issn/1051-8215/ (accessed 21/06/2016) (c) 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.
Publisher:	Institute of Electrical and Electronics Engineers
ISSN:	1051-8215
Date of First Compliant Deposit:	5 April 2016
Date of Acceptance:	17 March 2016
Last Modified:	07 Nov 2023 06:36
URI:	https://orca.cardiff.ac.uk/id/eprint/88715

Citation Data

Cited 6 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item