About

Benchmarks

No evaluation results yet. Help compare methods by submit evaluation metrics.

Subtasks

Datasets

Latest papers with code

Write-a-speaker: Text-based Emotional and Rhythmic Talking-head Generation

16 Apr 2021FuxiVirtualHuman/Write-a-Speaker

To be specific, our framework consists of a speaker-independent stage and a speaker-specific stage.

FACE MODEL MOTION CAPTURE TALKING HEAD GENERATION VIDEO GENERATION

11
16 Apr 2021

Character Controllers Using Motion VAEs

26 Mar 2021electronicarts/character-motion-vaes

A fundamental problem in computer animation is that of realizing purposeful and realistic human movement given a sufficiently-rich set of motion capture clips.

CONTINUOUS CONTROL MOTION CAPTURE MOTION SYNTHESIS

61
26 Mar 2021

Real-time RGBD-based Extended Body Pose Estimation

5 Mar 2021rmbashirov/rgbd-kinect-pose

We use parametric 3D deformable human mesh model (SMPL-X) as a representation and focus on the real-time estimation of parameters for the body pose, hands pose and facial expression from Kinect Azure RGB-D camera.

MOTION CAPTURE POSE ESTIMATION

9
05 Mar 2021

Robust Motion In-betweening

9 Feb 2021ubisoftinc/Ubisoft-LaForge-Animation-Dataset

To quantitatively evaluate performance on transitions and generalizations to longer time horizons, we present well-defined in-betweening benchmarks on a subset of the widely used Human3. 6M dataset and on LaFAN1, a novel high quality motion capture dataset that is more appropriate for transition generation.

MOTION CAPTURE MOTION PREDICTION

259
09 Feb 2021

Speech Emotion Recognition with Multiscale Area Attention and Data Augmentation

3 Feb 2021makcedward/nlpaug

In this paper, we apply multiscale area attention in a deep convolutional neural network to attend emotional characteristics with varied granularities and therefore the classifier can benefit from an ensemble of attentions with different scales.

DATA AUGMENTATION MOTION CAPTURE SPEECH EMOTION RECOGNITION

1,919
03 Feb 2021

Learning Continuous System Dynamics from Irregularly-Sampled Partial Observations

NeurIPS 2020 ZijieH/LG-ODE

In this paper, we propose to learn system dynamics from irregularly-sampled partial observations with underlying graph structure for the first time.

MOTION CAPTURE

6
08 Nov 2020

Robust Keypoint Detection and Pose Estimation of Robot Manipulators with Self-Occlusions via Sim-to-Real Transfer

15 Oct 2020jingpeilu/keypoint_optimization

The physical world experiments show how the proposed method can be applied to the wide-breadth of robotic applications that require visual feedback, such as camera-to-robot calibration, robotic tool tracking, and whole-arm pose estimation.

KEYPOINT DETECTION MOTION CAPTURE

3
15 Oct 2020

Motion Prediction Using Temporal Inception Module

6 Oct 2020tileb1/motion-prediction-tim

We argue that the diverse temporal scales are important as they allow us to look at the past frames with different receptive fields, which can lead to better predictions.

AUTONOMOUS DRIVING HUMAN MOTION PREDICTION MOTION CAPTURE MOTION PREDICTION

5
06 Oct 2020

Generative Model-Enhanced Human Motion Prediction

5 Oct 2020bouracha/OoDMotion

The task of predicting human motion is complicated by the natural heterogeneity and compositionality of actions, necessitating robustness to distributional shifts as far as out-of-distribution (OoD).

HUMAN MOTION PREDICTION MOTION CAPTURE MOTION PREDICTION

5
05 Oct 2020

A Primer on Motion Capture with Deep Learning: Principles, Pitfalls and Perspectives

1 Sep 2020DeepLabCut/Primer-MotionCapture

Extracting behavioral measurements non-invasively from video is stymied by the fact that it is a hard computational problem.

MOTION CAPTURE

13
01 Sep 2020