Search Results for author:
Found 20 papers, 5 papers with code
PhysAvatar: Learning the Physics of Dressed 3D Avatars from Visual Observations
This marks a significant advancement towards modeling photorealistic digital humans using physically based inverse rendering with physics in the loop.
CHOSEN: Contrastive Hypothesis Selection for Multi-View Depth Refinement
We propose CHOSEN, a simple yet flexible, robust and effective multi-view depth refinement framework.
MagicMirror: Fast and High-Quality Avatar Generation with a Constrained Search Space
We introduce a novel framework for 3D human avatar generation and personalization, leveraging text prompts to enhance user engagement and customization.
MACS: Mass Conditioned 3D Hand and Object Motion Synthesis
To improve the naturalness of the synthesized 3D hand object motions, this work proposes MACS the first MAss Conditioned 3D hand and object motion Synthesis approach.
Optimizing Diffusion Noise Can Serve As Universal Motion Priors
We propose Diffusion Noise Optimization (DNO), a new method that effectively leverages existing motion diffusion models as motion priors for a wide range of motion-related tasks.
Egocentric Whole-Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinement
In this work, we explore egocentric whole-body motion capture using a single fisheye camera, which simultaneously estimates human body and hand motion.
Ranked #1 on
Egocentric Pose Estimation
on GlobalEgoMocap Test Dataset
(using extra training data)
Preface: A Data-driven Volumetric Prior for Few-shot Ultra High-resolution Face Synthesis
NeRFs have enabled highly realistic synthesis of human faces including complex appearance and reflectance effects of hair and skin.
ITI-GEN: Inclusive Text-to-Image Generation
We show that, for some attributes, images can represent concepts more expressively than text.
Spectral Graphormer: Spectral Graph-based Transformer for Egocentric Two-Hand Reconstruction using Multi-View Color Images
We propose a novel transformer-based framework that reconstructs two high fidelity hands from multi-view RGB images.
Synthesizing Diverse Human Motions in 3D Indoor Scenes
We present a novel method for populating 3D indoor scenes with virtual humans that can navigate in the environment and interact with objects in a realistic manner.
Learning Personalized High Quality Volumetric Head Avatars from Monocular RGB Videos
The learnt avatar is driven by a parametric face model to achieve user-controlled facial expressions and head poses.
Compositional Human-Scene Interaction Synthesis with Semantic Control
Furthermore, inspired by the compositional nature of interactions that humans can simultaneously interact with multiple objects, we define interaction semantics as the composition of varying numbers of atomic action-object pairs.
EyeNeRF: A Hybrid Representation for Photorealistic Synthesis, Animation and Relighting of Human Eyes
The challenge of synthesizing eyes is multifold as it requires 1) appropriate representations for the various components of the eye and the periocular region for coherent viewpoint synthesis, capable of representing diffuse, refractive and highly reflective surfaces, 2) disentangling skin and eye appearance from environmental illumination such that it may be rendered under novel lighting conditions, and 3) capturing eyeball motion and the deformation of the surrounding skin to enable re-gazing.
VariTex: Variational Neural Face Textures
In this paper, we propose VariTex - to the best of our knowledge the first method that learns a variational latent feature space of neural face textures, which allows sampling of novel identities.
Deep Physics-aware Inference of Cloth Deformation for Monocular Human Performance Capture
Recent monocular human performance capture approaches have shown compelling dense tracking results of the full body from a single RGB camera.
ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variation
We show that our dataset can significantly improve the robustness of gaze estimation methods across different head poses and gaze angles.
Ranked #1 on
Gaze Estimation
on ETH-XGaze
(using extra training data)
Neural Style-Preserving Visual Dubbing
We present a style-preserving visual dubbing approach from single video inputs, which maintains the signature style of target actors when modifying facial expressions, including mouth motions, to match foreign languages.
3D Morphable Face Models -- Past, Present and Future
In this paper, we provide a detailed survey of 3D Morphable Face Models over the 20 years since they were first proposed.
A Practical Method for Fully Automatic Intrinsic Camera Calibration Using Directionally Encoded Light
Calibrating the intrinsic properties of a camera is one of the fundamental tasks required for a variety of computer vision and image processing tasks.
FaceDirector: Continuous Control of Facial Performance in Video
We present a method to continuously blend between multiple facial performances of an actor, which can contain different facial expressions or emotional states.
