Facial Action Unit Detection

17 papers with code • 2 benchmarks • 4 datasets

Facial action unit detection is the task of detecting action units from a video of a face - for example, lip tightening and cheek raising.

( Image credit: Self-supervised Representation Learning from Videos for Facial Action Unit Detection )

Libraries

Use these libraries to find Facial Action Unit Detection models and implementations

GPT as Psychologist? Preliminary Evaluations for GPT-4V on Visual Affective Computing

envision-research/gpt4affectivity 9 Mar 2024

In conclusion, this paper provides valuable insights into the potential applications and challenges of MLLMs in human-centric computing.

19
09 Mar 2024

AUFormer: Vision Transformers are Parameter-Efficient Facial Action Unit Detectors

yuankaishen2001/auformer 7 Mar 2024

Facial Action Units (AU) is a vital concept in the realm of affective computing, and AU detection has always been a hot research topic.

12
07 Mar 2024

Learning Contrastive Feature Representations for Facial Action Unit Detection

ziqiao-shang/aunce 9 Feb 2024

To address the challenge posed by noisy AU labels, we augment the supervised signal through the introduction of a self-supervised signal.

2
09 Feb 2024

FG-Net: Facial Action Unit Detection with Generalizable Pyramidal Features

ihp-lab/fg-net 23 Aug 2023

The proposed FG-Net achieves a strong generalization ability for heatmap-based AU detection thanks to the generalizable and semantic-rich features extracted from the pre-trained generative model.

12
23 Aug 2023

Multi-scale Promoted Self-adjusting Correlation Learning for Facial Action Unit Detection

yuankaishen2001/Self-adjusting-AU 15 Aug 2023

Anatomically, there are innumerable correlations between AUs, which contain rich information and are vital for AU detection.

7
15 Aug 2023

Learning Multi-dimensional Edge Feature-based AU Relation Graph for Facial Action Unit Recognition

tomas-gajarsky/facetorch 2 May 2022

While the relationship between a pair of AUs can be complex and unique, existing approaches fail to specifically and explicitly represent such cues for each pair of AUs in each facial display.

405
02 May 2022

Pre-training strategies and datasets for facial representation learning

tomas-gajarsky/facetorch 30 Mar 2021

Recent work on Deep Learning in the area of face analysis has focused on supervised learning for specific tasks of interest (e. g. face recognition, facial landmark localization etc.)

405
30 Mar 2021

Automated Detection of Equine Facial Action Units

ZhenghLi/Automated-Detection-of-Equine-Facial-Action-Units 17 Feb 2021

To automate parts of this process, we propose a Deep Learning-based method to detect EquiFACS units automatically from images.

5
17 Feb 2021

J$\hat{\text{A}}$A-Net: Joint Facial Action Unit Detection and Face Alignment via Adaptive Attention

ZhiwenShao/PyTorch-JAANet 18 Mar 2020

Moreover, to extract precise local features, we propose an adaptive attention learning module to refine the attention map of each AU adaptively.

93
18 Mar 2020

Multitask Emotion Recognition with Incomplete Labels

wtomin/A-Multitask-Solution-for-FAU-EXPR-VA 10 Feb 2020

We use the soft labels and the ground truth to train the student model.

110
10 Feb 2020