Action Unit Detection

14 papers with code • 1 benchmarks • 3 datasets

Action unit detection is the task of detecting action units from a video - for example, types of facial action units (lip tightening, cheek raising) from a video of a face.

( Image credit: AU R-CNN )

Libraries

Use these libraries to find Action Unit Detection models and implementations

Learning Contrastive Feature Representations for Facial Action Unit Detection

ziqiao-shang/aunce 9 Feb 2024

To address the challenge posed by noisy AU labels, we augment the supervised signal through the introduction of a self-supervised signal.

2
09 Feb 2024

FG-Net: Facial Action Unit Detection with Generalizable Pyramidal Features

ihp-lab/fg-net 23 Aug 2023

The proposed FG-Net achieves a strong generalization ability for heatmap-based AU detection thanks to the generalizable and semantic-rich features extracted from the pre-trained generative model.

12
23 Aug 2023

Multi-scale Promoted Self-adjusting Correlation Learning for Facial Action Unit Detection

yuankaishen2001/Self-adjusting-AU 15 Aug 2023

Anatomically, there are innumerable correlations between AUs, which contain rich information and are vital for AU detection.

6
15 Aug 2023

EmotiEffNet Facial Features in Uni-task Emotion Recognition in Video at ABAW-5 competition

HSE-asavchenko/face-emotion-recognition 16 Mar 2023

In this article, the results of our team for the fifth Affective Behavior Analysis in-the-wild (ABAW) competition are presented.

553
16 Mar 2023

Video-Based Frame-Level Facial Analysis of Affective Behavior on Mobile Devices Using EfficientNets

HSE-asavchenko/face-emotion-recognition CVPR Workshop 2022

In this paper, we consider the problem of real-time video-based facial emotion analytics, namely, facial expression recognition, prediction of valence and arousal and detection of action unit points.

553
10 Jun 2022

J$\hat{\text{A}}$A-Net: Joint Facial Action Unit Detection and Face Alignment via Adaptive Attention

ZhiwenShao/PyTorch-JAANet 18 Mar 2020

Moreover, to extract precise local features, we propose an adaptive attention learning module to refine the attention map of each AU adaptively.

93
18 Mar 2020

Multitask Emotion Recognition with Incomplete Labels

wtomin/A-Multitask-Solution-for-FAU-EXPR-VA 10 Feb 2020

We use the soft labels and the ground truth to train the student model.

110
10 Feb 2020

Self-Supervised Representation Learning From Videos for Facial Action Unit Detection

mysee1989/TCAE CVPR 2019

In this paper, we aim to learn discriminative representation for facial action unit (AU) detection from large amount of videos without manual annotations.

157
01 Jun 2019

Unconstrained Facial Action Unit Detection via Latent Feature Domain

ZhiwenShao/ADLD 25 Mar 2019

Due to the combination of source AU-related information and target AU-free information, the latent feature domain with transferred source label can be learned by maximizing the target-domain AU detection performance.

28
25 Mar 2019

AU R-CNN: Encoding Expert Prior Knowledge into R-CNN for Action Unit Detection

machanic/AU_R-CNN 14 Dec 2018

(2) We integrate various dynamic models (including convolutional long short-term memory, two stream network, conditional random field, and temporal action localization network) into AU R-CNN and then investigate and analyze the reason behind the performance of dynamic models.

86
14 Dec 2018