Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

Lightweight photometric stereo for facial details recovery

Wang, Xueying, Guo, Yudong, Deng, Bailin and Zhang, Juyong 2020. Lightweight photometric stereo for facial details recovery. Presented at: Conference on Computer Vision and Pattern Recognition (CVPR 2020), Seattle, Washington, USA, 16-18 June 2020. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE,

[img]
Preview
PDF - Supplemental Material
Download (7MB) | Preview
[img]
Preview
PDF - Accepted Post-Print Version
Download (8MB) | Preview

Abstract

Recently, 3D face reconstruction from a single image has achieved great success with the help of deep learning and shape prior knowledge, but they often fail to produce accurate geometry details. On the other hand, photometric stereo methods can recover reliable geometry details, but require dense inputs and need to solve a complex optimization problem. In this paper, we present a lightweight strategy that only requires sparse inputs or even a single image to recover high-fidelity face shapes with images captured under near-field lights. To this end, we construct a dataset containing 84 different subjects with 29 expressions under 3 different lights. Data augmentation is applied to enrich the data in terms of diversity in identity, lighting, expression, etc. With this constructed dataset, we propose a novel neural network specially designed for photometric stereo based 3D face reconstruction. Extensive experiments and comparisons demonstrate that our method can generate high-quality reconstruction results with one to three facial images captured under near-field lights. Our full framework is available at https://github.com/Juyong/FacePSNet.

Item Type: Conference or Workshop Item (Paper)
Status: In Press
Schools: Computer Science & Informatics
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Q Science > QA Mathematics > QA76 Computer software
Publisher: IEEE
Date of First Compliant Deposit: 30 March 2020
Date of Acceptance: 27 February 2020
Last Modified: 16 Jun 2020 02:05
URI: http://orca.cf.ac.uk/id/eprint/130641

Actions (repository staff only)

Edit Item Edit Item

Downloads

Downloads per month over past year

View more statistics