Search Results for author:
Found 18 papers, 11 papers with code
Taming Stable Diffusion for Text to 360° Panorama Image Generation
Generative models, e. g., Stable Diffusion, have enabled the creation of photorealistic images from text prompts.
ClusteringSDF: Self-Organized Neural Implicit Surfaces for 3D Decomposition
3D decomposition/segmentation still remains a challenge as large-scale 3D annotated data is not readily available.
HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compression
3D Gaussian Splatting (3DGS) has emerged as a promising framework for novel view synthesis, boasting rapid rendering speed with high fidelity.
ObjectSDF++: Improved Object-Compositional Neural Implicit Surfaces
Unlike traditional multi-view stereo approaches, the neural implicit surface-based methods leverage neural networks to represent 3D scenes as signed distance functions (SDFs).
Explicit Correspondence Matching for Generalizable Neural Radiance Fields
The key to our approach lies in the explicitly modeled correspondence matching information, so as to provide the geometry prior to the prediction of NeRF color and density for volume rendering.
Make Your Brief Stroke Real and Stereoscopic: 3D-Aware Simplified Sketch to Portrait Generation
Creating the photo-realistic version of people sketched portraits is useful to various entertainment purposes.
Masked Lip-Sync Prediction by Audio-Visual Contextual Exploitation in Transformers
This requires masking a large percentage of the original image and seamlessly inpainting it with the aid of audio and reference frames.
Audio-Driven Co-Speech Gesture Video Generation
Our key insight is that the co-speech gestures can be decomposed into common motion patterns and subtle rhythmic dynamics.
Object-Compositional Neural Implicit Surfaces
This paper proposes a novel framework, ObjectSDF, to build an object-compositional neural implicit representation with high fidelity in 3D reconstruction and object representation.
EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model
Although significant progress has been made to audio-driven talking face generation, existing methods either neglect facial emotion or cannot be applied to arbitrary subjects.
TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial Editing
In this study, we highlight the importance of interaction in a dual-space GAN for more controllable editing.
Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation
To enhance the quality of synthesized gestures, we develop a contrastive learning strategy based on audio-text alignment for better audio representations.
Ranked #3 on
Gesture Generation
on TED Gesture Dataset
Sem2NeRF: Converting Single-View Semantic Masks to Neural Radiance Fields
In light of recent advances in NeRF-based 3D-aware generative models, we introduce a new task, Semantic-to-NeRF translation, that aims to reconstruct a 3D scene modelled by NeRF, conditioned on one single-view semantic mask as input.
Ranked #1 on
3D-Aware Image Synthesis
on CelebAMask-HQ
Exploring Smoothness and Class-Separation for Semi-supervised Medical Image Segmentation
The pixel-level smoothness forces the model to generate invariant results under adversarial perturbations.
Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generation
Moreover, to enable portrait rendering in one unified neural radiance field, a Torso Deformation module is designed to stabilize the large-scale non-rigid torso motions.
AOT: Appearance Optimal Transport Based Identity Swapping for Forgery Detection
However, due to the lack of Deepfakes datasets with large variance in appearance, which can be hardly produced by recent identity swapping methods, the detection algorithm may fail in this situation.
Disentangled Representation Learning for 3D Face Shape
In this paper, we present a novel strategy to design disentangled 3D face shape representation.
Alive Caricature from 2D to 3D
Caricature is an art form that expresses subjects in abstract, simple and exaggerated view.
