Wing Loss for Robust Facial Landmark Localisation with Convolutional Neural Networks

We present a new loss function, namely Wing loss, for robust facial landmark localisation with Convolutional Neural Networks (CNNs). We first compare and analyse different loss functions including L2, L1 and smooth L1. The analysis of these loss functions suggests that, for the training of a CNN-based localisation model, more attention should be paid to small and medium range errors. To this end, we design a piece-wise loss function. The new loss amplifies the impact of errors from the interval (-w, w) by switching from L1 loss to a modified logarithm function. To address the problem of under-representation of samples with large out-of-plane head rotations in the training set, we propose a simple but effective boosting strategy, referred to as pose-based data balancing. In particular, we deal with the data imbalance problem by duplicating the minority training samples and perturbing them by injecting random image rotation, bounding box translation and other data augmentation approaches. Last, the proposed approach is extended to create a two-stage framework for robust facial landmark localisation. The experimental results obtained on AFLW and 300W demonstrate the merits of the Wing loss function, and prove the superiority of the proposed method over the state-of-the-art approaches.

PDF Abstract CVPR 2018 PDF CVPR 2018 Abstract

Results from the Paper


 Ranked #1 on Face Alignment on 300W (NME_inter-pupil (%, Common) metric)

     Get a GitHub badge
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Face Alignment 300W Wing NME_inter-pupil (%, Full) 4.04 # 3
NME_inter-pupil (%, Common) 3.27 # 1
NME_inter-pupil (%, Challenge) 7.18 # 14
Face Alignment AFLW-19 Wing NME_diag (%, Full) 1.65 # 14
NME_box (%, Full) 3.56 # 9
AUC_box@0.07 (%, Full) 53.5 # 8
Face Alignment WFLW Wing NME (inter-ocular) 5.11 # 27
AUC@10 (inter-ocular) 55.4 # 21
FR@10 (inter-ocular) 6.00 # 22

Results from Other Papers


Task Dataset Model Metric Name Metric Value Rank Source Paper Compare
Face Alignment COFW Wing (Feng et al., 2018) NME (inter-ocular) 5.07 # 20

Methods


No methods listed for this paper. Add relevant methods here