Search Results for author:
Found 41 papers, 21 papers with code
VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Time
We introduce VASA, a framework for generating lifelike talking faces with appealing visual affective skills (VAS) given a single static image and a speech audio clip.
GaussianCube: Structuring Gaussian Splatting using Optimal Transport for 3D Generative Modeling
To address the problem, we introduce GaussianCube, a structured GS representation that is both powerful and efficient for generative modeling.
Diffusion Models are Geometry Critics: Single Image 3D Editing Using Pre-Trained Diffusion Priors
We propose a novel image editing technique that enables 3D manipulations on single images, such as object rotation and translation.
A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars
The objective of this paper is to develop a functional system for translating spoken languages into sign languages, referred to as Spoken2Sign translation.
Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairs
This work delves into the task of pose-free novel view synthesis from stereo pairs, a challenging and pioneering task in 3D vision.
AniPortraitGAN: Animatable 3D Portrait Generation from 2D Image Collections
For the new task, we base our method on the generative radiance manifold representation and equip it with learnable facial and head-shoulder deformations.
3D-aware Image Generation using 2D Diffusion Models
In this paper, we introduce a novel 3D-aware image generation method that leverages 2D diffusion models.
RemoteTouch: Enhancing Immersive 3D Video Communication with Hand Touch
A key challenge in emulating the remote hand touch is the realistic rendering of the participant's hand and arm as the hand touches the screen.
FreeEnricher: Enriching Face Landmarks without Additional Cost
To evaluate our method, we manually label the dense landmarks on 300W testset.
Ranked #1 on
Face Alignment
on 300W
NeRFInvertor: High Fidelity NeRF-GAN Inversion for Single-shot Real Image Animation
Furthermore, our method leverages explicit and implicit 3D regularizations using the in-domain neighborhood samples around the optimized latent code to remove geometrical and visual artifacts.
A Structure-Guided Diffusion Model for Large-Hole Image Completion
The structure generator generates an edge image representing plausible structures within the holes, which is then used for guiding the texture generation process.
AniFaceGAN: Animatable 3D-Aware Face Image Generation for Video Avatars
To achieve meaningful control over facial expressions via deformation, we propose a 3D-level imitative learning scheme between the generator and a parametric 3D face model during adversarial training of the 3D-aware GAN.
Generative Deformable Radiance Fields for Disentangled Image Synthesis of Topology-Varying Objects
Experiments show that our method can successfully learn the generative model from unstructured monocular images and well disentangle the shape and appearance for objects (e. g., chairs) with large topological variance.
Deep Deformable 3D Caricatures with Learned Shape Control
To achieve the goal, we propose an MLP-based framework for building a deformable surface model, which takes a latent code and produces a 3D surface.
GRAM-HD: 3D-Consistent Image Generation at High Resolution with Generative Radiance Manifolds
This paper proposes a novel 3D-aware GAN that can generate high resolution images (up to 1024X1024) while keeping strict 3D consistency as in volume rendering.
Single-View View Synthesis in the Wild with Learned Adaptive Multiplane Images
This paper deals with the challenging task of synthesizing novel views for in-the-wild photographs.
Real-Time Neural Character Rendering with Pose-Guided Multiplane Images
We propose pose-guided multiplane image (MPI) synthesis which can render an animatable character in real scenes with photorealistic quality.
MPS-NeRF: Generalizable 3D Human Rendering from Multiview Images
For this task, we propose a simple yet effective method to train a generalizable NeRF with multiview images as conditional input.
GRAM: Generative Radiance Manifolds for 3D-Aware Image Generation
3D-aware image generative modeling aims to generate 3D-consistent images with explicitly controllable camera poses.
VirtualCube: An Immersive 3D Video Communication System
The VirtualCube system is a 3D video conference system that attempts to overcome some limitations of conventional technologies.
Physics-based Noise Modeling for Extreme Low-light Photography
Enhancing the visibility in extreme low-light environments is a challenging task.
Ranked #4 on
Image Denoising
on SID SonyA7S2 x100
StyleCariGAN: Caricature Generation via StyleGAN Feature Map Modulation
Our framework, dubbed StyleCariGAN, automatically creates a realistic and detailed caricature from an input photo with optional controls on shape exaggeration degree and color stylization type.
Disentangled Face Attribute Editing via Instance-Aware Latent Space Search
We further propose a Disentanglement-Transformation (DT) metric to quantify the attribute transformation and disentanglement efficacy and find the optimal control factor between attribute-level and instance-specific directions based on it.
High-Resolution Optical Flow from 1D Attention and Correlation
Optical flow is inherently a 2D search problem, and thus the computational complexity grows quadratically with respect to the search window, making large displacements matching infeasible for high-resolution images.
Learning High-Fidelity Face Texture Completion Without Complete Face Texture
For face texture completion, previous methods typically use some complete textures captured by multiview imaging systems or 3D scanners for supervised learning.
Deformed Implicit Field: Modeling 3D Shapes with Learned Dense Correspondence
We propose a novel Deformed Implicit Field (DIF) representation for modeling 3D shapes of a category and generating dense correspondences among shapes.
Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learning
Our method can also be used to embed real images into the disentangled latent space.
Deep 3D Portrait from a Single Image
We evaluate the accuracy of our method both in 3D and with pose manipulation tasks on 2D images.
A Physics-based Noise Formation Model for Extreme Low-light Raw Denoising
Lacking rich and realistic data, learned single image denoising algorithms generalize poorly to real raw images that do not resemble the data used for training.
Ranked #5 on
Image Denoising
on ELD SonyA7S2 x200
Single Image Reflection Removal Exploiting Misaligned Training Data and Network Enhancements
Removing undesirable reflections from a single image captured through a glass window is of practical importance to visual computing systems.
Ranked #2 on
Reflection Removal
on SIR^2(Objects)
Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Set
Recently, deep learning based 3D face reconstruction methods have shown promising results in both quality and efficiency. However, training deep neural networks typically requires a large volume of data, whereas face images with ground-truth 3D face shapes are scarce.
Ranked #3 on
3D Face Reconstruction
on Florence
(RMSE Cooperative metric)
Image Smoothing via Unsupervised Learning
Image smoothing represents a fundamental component of many disparate computer vision and graphics applications.
Deep Single-View 3D Object Reconstruction with Visual Hull Embedding
The key idea of our method is to leverage object mask and pose estimation from CNNs to assist the 3D shape learning by constructing a probabilistic single-view visual hull inside of the network.
LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks
Although weight and activation quantization is an effective approach for Deep Neural Network (DNN) compression and has a lot of potentials to increase inference speed leveraging bit-operations, there is still a noticeable gap in terms of prediction accuracy between the quantized model and the full-precision model.
Fast, Accurate Thin-Structure Obstacle Detection for Autonomous Mobile Robots
This work is devoted to a task that is indispensable for safety yet was largely overlooked in the past -- detecting obstacles that are of very thin structures, such as wires, cables and tree branches.
A Generic Deep Architecture for Single Image Reflection Removal and Image Smoothing
This paper proposes a deep neural network structure that exploits edge information in addressing representative low-level vision tasks such as layer separation and image filtering.
Revisiting Deep Intrinsic Image Decompositions
While invaluable for many computer vision applications, decomposing a natural image into intrinsic reflectance and shading layers represents a challenging, underdetermined inverse problem.
Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registration
The evaluation demonstrates that the proposed method is able to produce reliable registration results regardless of the initialization.
Ranked #6 on
Point Cloud Registration
on FP-O-H
Robust Optical Flow Estimation of Double-Layer Images under Transparency or Reflection
This paper deals with a challenging, frequently encountered, yet not properly investigated problem in two-frame optical flow estimation.
Neural Aggregation Network for Video Face Recognition
The network takes a face video or face image set of a person with a variable number of face images as its input, and produces a compact, fixed-dimension feature representation for recognition.
Ranked #7 on
Face Verification
on IJB-A
Dense, Accurate Optical Flow Estimation With Piecewise Parametric Model
This paper proposes a simple method for estimating dense and accurate optical flow field.
