Search Results for author:
Found 16 papers, 7 papers with code
MetaCap: Meta-learning Priors from Multi-View Imagery for Sparse-view Human Performance Capture and Rendering
Our key idea is to meta-learn the radiance field weights solely from potentially sparse multi-view videos, which can serve as a prior when fine-tuning them on sparse imagery depicting the human.
ConvoFusion: Multi-Modal Conversational Diffusion for Co-Speech Gesture Synthesis
Gestures play a key role in human communication.
ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactions
Current approaches for 3D human motion synthesis generate high quality animations of digital humans performing a wide variety of actions and gestures.
3D-QAE: Fully Quantum Auto-Encoding of 3D Point Clouds
It is trained on collections of 3D point clouds to produce their compressed representations.
ROAM: Robust and Object-Aware Motion Generation Using Neural Pose Descriptors
Given an unseen object and a reference pose-object pair, we optimise for the object-aware pose that is closest in the feature space to the reference pose.
IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactions
Is it possible to synthesize such motion plausibly with a diverse set of objects and instructions?
MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesis
Conventional methods for human motion synthesis are either deterministic or struggle with the trade-off between motion diversity and motion quality.
Ranked #6 on
Motion Synthesis
on AIST++
State of the Art in Dense Monocular Non-Rigid 3D Reconstruction
3D reconstruction of deformable (or non-rigid) scenes from a set of monocular 2D image observations is a long-standing and actively researched area of computer vision and graphics.
Gravity-Aware Monocular 3D Human-Object Reconstruction
We evaluate GraviCap on a new dataset with ground-truth annotations for persons and different objects undergoing free flights.
Cross-Modal learning for Audio-Visual Video Parsing
In this paper, we present a novel approach to the audio-visual video parsing (AVVP) task that demarcates events from a video separately for audio and visual modalities.
Ranked #1 on
Event Detection
on Audio Set
Rudder: A Cross Lingual Video and Text Retrieval Dataset
Video retrieval using natural language queries requires learning semantically meaningful joint embeddings between the text and the audio-visual input.
Ranked #1 on
Video Retrieval
on Charades-STA
Learning Unsupervised Cross-domain Image-to-Image Translation Using a Shared Discriminator
We assess the qualitative and quantitative results on image transfiguration, a cross-domain translation task, in a setting where the target domain shares similar semantics to the source domain.
Ranked #1 on
Image-to-Image Translation
on Zebra and Horses
LIGHTEN: Learning Interactions with Graph and Hierarchical TEmporal Networks for HOI in videos
Analyzing the interactions between humans and objects from a video includes identification of the relationships between humans and the objects present in the video.
Human-Object Interaction Detection
Relationship Detection
+1
Multi-Person 3D Human Pose Estimation from Monocular Images
Multi-person 3D human pose estimation from a single image is a challenging problem, especially for in-the-wild settings due to the lack of 3D annotated data.
Ranked #8 on
3D Multi-Person Pose Estimation
on MuPoTS-3D
3D Human Pose Estimation
3D Multi-Person Human Pose Estimation
Progression Modelling for Online and Early Gesture Detection
Online and Early detection of gestures is crucial for building touchless gesture based interfaces.
Learning 3D Human Pose from Structure and Motion
3D human pose estimation from a single image is a challenging problem, especially for in-the-wild settings due to the lack of 3D annotated data.
Ranked #24 on
Monocular 3D Human Pose Estimation
on Human3.6M
Monocular 3D Human Pose Estimation
Weakly-supervised Learning
