Dense Face Alignment

5 Sep 2017  ·  Yaojie Liu, Amin Jourabloo, William Ren, Xiaoming Liu ·

Face alignment is a classic problem in the computer vision field. Previous works mostly focus on sparse alignment with a limited number of facial landmark points, i.e., facial landmark detection. In this paper, for the first time, we aim at providing a very dense 3D alignment for large-pose face images. To achieve this, we train a CNN to estimate the 3D face shape, which not only aligns limited facial landmarks but also fits face contours and SIFT feature points. Moreover, we also address the bottleneck of training CNN with multiple datasets, due to different landmark markups on different datasets, such as 5, 34, 68. Experimental results show our method not only provides high-quality, dense 3D face fitting but also outperforms the state-of-the-art facial landmark detection methods on the challenging datasets. Our model can run at real time during testing.

PDF Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
3D Face Reconstruction AFLW2000-3D DeFA Mean NME 5.6454% # 7
Face Alignment AFLW2000-3D DeFA Mean NME 4.50% # 11
Face Alignment AFLW-LFPA DeFA Mean NME 3.86% # 2

Methods


No methods listed for this paper. Add relevant methods here