Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

Learning 3D face reconstruction from a single sketch

Yang, Li, Wu, Jing, Huo, Jing, Lai, Yu-Kun and Gao, Yang 2021. Learning 3D face reconstruction from a single sketch. Graphical Models 115 , 101102. 10.1016/j.gmod.2021.101102
Item availability restricted.

[img] PDF - Accepted Post-Print Version
Restricted to Repository staff only until 26 March 2022 due to copyright restrictions.
Available under License Creative Commons Attribution Non-commercial No Derivatives.

Download (12MB)


3D face reconstruction from a single image is a classic computer vision problem with many applications. However, most works achieve reconstruction from face photos, and little attention has been paid to reconstruction from other portrait forms. In this paper, we propose a learning-based approach to reconstruct a 3D face from a single face sketch. To overcome the problem of no paired sketch-3D data for supervised learning, we introduce a photo-to-sketch synthesis technique to obtain paired training data, and propose a dual-path architecture to achieve synergistic 3D reconstruction from both sketches and photos. We further propose a novel line loss function to refine the reconstruction with characteristic details depicted by lines in sketches well preserved. Our method outperforms the state-of-the-art 3D face reconstruction approaches in terms of reconstruction from face sketches. We also demonstrate the use of our method for easy editing of details on 3D face models.

Item Type: Article
Date Type: Publication
Status: Published
Schools: Computer Science & Informatics
Publisher: Elsevier
ISSN: 1524-0703
Date of First Compliant Deposit: 12 April 2021
Date of Acceptance: 16 March 2021
Last Modified: 13 May 2021 11:00

Actions (repository staff only)

Edit Item Edit Item


Downloads per month over past year

View more statistics