Search Results for author:
Found 24 papers, 11 papers with code
Monocular 3D Object Detection via Feature Domain Adaptation
Monocular 3D object detection is a challenging task due to unreliable depth, resulting in a distinct performance gap between monocular and LiDAR-based approaches.
Example-Guided Image Synthesis using Masked Spatial-Channel Attention and Self-Supervision
Example-guided image synthesis has recently been attempted to synthesize an image from a semantic label map and an exemplary image.
TextToon: Real-Time Text Toonify Head Avatar from Single Video
Given a short monocular video sequence and a written instruction about the avatar style, our model can generate a high-fidelity toonified avatar that can be driven in real-time by another video with arbitrary identities.
Spectrum AUC Difference (SAUCD): Human-aligned 3D Shape Evaluation
Then, we calculate the Area Under the Curve (AUC) difference between the two spectrums, so that each frequency band that captures either the overall or detailed shape is equitably considered.
Tri$^{2}$-plane: Thinking Head Avatar via Feature Pyramid
Recent years have witnessed considerable achievements in facial avatar reconstruction with neural volume rendering.
Relit-NeuLF: Efficient Relighting and Novel View Synthesis via Neural 4D Light Field
A DecomposeNet learns to map each ray to its SVBRDF components: albedo, normal, and roughness.
NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functions
The spatial positions of their neural features are fixed on grid nodes and cannot well adapt to target signals.
Uncertainty-aware State Space Transformer for Egocentric 3D Hand Trajectory Forecasting
In this paper, we set up an egocentric 3D hand trajectory forecasting task that aims to predict hand trajectories in a 3D space from early observed RGB videos in a first-person view.
MyStyle++: A Controllable Personalized Generative Prior
In this paper, we propose an approach to obtain a personalized generative prior with explicit control over a set of attributes.
Harnessing Low-Frequency Neural Fields for Few-Shot View Synthesis
We further propose a simple-yet-effective strategy for tuning the frequency to avoid overfitting few-shot inputs: enforcing consistency among the frequency domain of rendered 2D images.
3D-Aware Facial Landmark Detection via Multi-View Consistent Training on Synthetic Data
Accurate facial landmark detection on wild images plays an essential role in human-computer interaction, entertainment, and medical applications.
NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fields
Visually exploring in a real-world 4D spatiotemporal space freely in VR has been a long-term quest.
High-fidelity Face Tracking for AR/VR via Deep Lighting Adaptation
This paper addresses previous limitations by learning a deep learning lighting model, that in combination with a high-quality 3D face tracking algorithm, provides a method for subtle and robust facial motion transfer from a regular video to a 3D photo-realistic avatar.
Talking-head Generation with Rhythmic Head Motion
When people deliver a speech, they naturally move heads, and this rhythmic head motion conveys prosodic information.
What comprises a good talking-head video generation?: A Survey and Benchmark
In this work, we present a carefully-designed benchmark for evaluating talking-head video generation with standardized dataset pre-processing strategies.
Example-Guided Image Synthesis across Arbitrary Scenes using Masked Spatial-Channel Attention and Self-Supervision
Example-guided image synthesis has recently been attempted to synthesize an image from a semantic label map and an exemplary image.
TailorGAN: Making User-Defined Fashion Designs
To overcome those limitations, we propose a novel self-supervised model to synthesize garment images with disentangled attributes (e. g., collar and sleeves) without paired data.
Example-Guided Scene Image Synthesis using Masked Spatial-Channel Attention and Patch-Based Self-Supervision
Example-guided image synthesis has been recently attempted to synthesize an image from a semantic label map and an exemplary image.
Unsupervised Pose Flow Learning for Pose Guided Synthesis
Pose guided synthesis aims to generate a new image in an arbitrary target pose while preserving the appearance details from the source image.
Hierarchical Cross-Modal Talking Face Generation With Dynamic Pixel-Wise Loss
We devise a cascade GAN approach to generate talking face video, which is robust to different face shapes, view angles, facial characteristics, and noisy audio conditions.
Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Loss
We devise a cascade GAN approach to generate talking face video, which is robust to different face shapes, view angles, facial characteristics, and noisy audio conditions.
Lip Movements Generation at a Glance
In this paper, we consider a task of such: given an arbitrary audio speech and one lip image of arbitrary target identity, generate synthesized lip movements of the target identity saying the speech.
MRI Tumor Segmentation with Densely Connected 3D CNN
The major difficulty of our segmentation model comes with the fact that the location, structure, and shape of gliomas vary significantly among different patients.
Deep Cross-Modal Audio-Visual Generation
Being the first to explore this new problem, we compose two new datasets with pairs of images and sounds of musical performances of different instruments.
