Facial Action Unit Detection
13 papers with code • 2 benchmarks • 4 datasets
Facial action unit detection is the task of detecting action units from a video of a face - for example, lip tightening and cheek raising.
( Image credit: Self-supervised Representation Learning from Videos for Facial Action Unit Detection )
Benchmarks
These leaderboards are used to track progress in Facial Action Unit Detection
| Trend | Dataset | Best Model | Paper | Code | Compare |
|---|---|---|---|---|---|
|
|||||
|
Libraries
Use these libraries to find Facial Action Unit Detection models and implementations
DISFA
BP4D
CANDOR Corpus
Thermal Face Database
Most implemented papers
Multitask Emotion Recognition with Incomplete Labels
wtomin/Multitask-Emotion-Recognition-with-Incomplete-Labels
•
•
We use the soft labels and the ground truth to train the student model.
Deep Region and Multi-Label Learning for Facial Action Unit Detection
Region learning (RL) and multi-label learning (ML) have recently attracted increasing attentions in the field of facial Action Unit (AU) detection.
Linear Disentangled Representation Learning for Facial Actions
Limited annotated data available for the recognition of facial expression and action units embarrasses the training of deep networks, which can learn disentangled invariant features.
Pre-training strategies and datasets for facial representation learning
1adrianb/unsupervised-face-representation
•
•
Recent work on Deep Learning in the area of face analysis has focused on supervised learning for specific tasks of interest (e. g. face recognition, facial landmark localization etc.)
Learning Multi-dimensional Edge Feature-based AU Relation Graph for Facial Action Unit Recognition
While the relationship between a pair of AUs can be complex and unique, existing approaches fail to specifically and explicitly represent such cues for each pair of AUs in each facial display.
Multi-View Dynamic Facial Action Unit Detection
We then move to the novel setup of the FERA 2017 Challenge, in which we propose a multi-view extension of our approach that operates by first predicting the viewpoint from which the video was taken, and then evaluating an ensemble of action unit detectors that were trained for that specific viewpoint.
Deep Adaptive Attention for Joint Facial Action Unit Detection and Face Alignment
ZhiwenShao/JAANet
•
•
ECCV 2018
Facial action unit (AU) detection and face alignment are two highly correlated tasks since facial landmarks can provide precise AU locations to facilitate the extraction of meaningful local features for AU detection.
Unconstrained Facial Action Unit Detection via Latent Feature Domain
ZhiwenShao/ADLD
•
•
Due to the combination of source AU-related information and target AU-free information, the latent feature domain with transferred source label can be learned by maximizing the target-domain AU detection performance.
Self-Supervised Representation Learning From Videos for Facial Action Unit Detection
In this paper, we aim to learn discriminative representation for facial action unit (AU) detection from large amount of videos without manual annotations.
Multi-label Co-regularization for Semi-supervised Facial Action Unit Recognition
nxsEdson/MLCR
•
•
NeurIPS 2019
In this work, we propose a semi-supervised approach for AU recognition utilizing a large number of web face images without AU labels and a relatively small face dataset with AU annotations inspired by the co-training methods.
