Search Results for author:
Found 30 papers, 20 papers with code
Rethinking End-to-End 2D to 3D Scene Segmentation in Gaussian Splatting
Therefore, we formulate the association learning module and the noisy label filtering module for effective and robust codebook learning.
PCGS: Progressive Compression of 3D Gaussian Splatting
To address this issue, we propose PCGS (Progressive Compression of 3D Gaussian Splatting), which adaptively controls both the quantity and quality of Gaussians (or anchors) to enable effective progressivity for on-demand applications.
F3D-Gaus: Feed-forward 3D-aware Generation on ImageNet with Cycle-Consistent Gaussian Splatting
This paper tackles the problem of generalizable 3D-aware generation from monocular datasets, e. g., ImageNet.
PanSplat: 4K Panorama Synthesis with Feed-Forward Gaussian Splatting
With the advent of portable 360{\deg} cameras, panorama has gained significant attention in applications like virtual reality (VR), virtual tours, robotics, and autonomous driving.
Normal-GS: 3D Gaussian Splatting with Normal-Involved Rendering
Previous attempts to regularize 3D Gaussian normals often degrade rendering quality due to the fundamental disconnect between normal vectors and the rendering pipeline in 3DGS-based methods.
PCF-Lift: Panoptic Lifting by Probabilistic Contrastive Fusion
Panoptic lifting is an effective technique to address the 3D panoptic segmentation task by unprojecting 2D panoptic segmentations from multi-views to 3D scene.
Fast Feedforward 3D Gaussian Splatting Compression
With 3D Gaussian Splatting (3DGS) advancing real-time and high-fidelity rendering for novel view synthesis, storage requirements pose challenges for their widespread adoption.
TFS-NeRF: Template-Free NeRF for Semantic 3D Reconstruction of Dynamic Scene
Despite advancements in Neural Implicit models for 3D surface reconstruction, handling dynamic environments with interactions between arbitrary rigid, non-rigid, or deformable entities remains challenging.
How Far Can We Compress Instant-NGP-Based NeRF?
In this paper, we introduce the Context-based NeRF Compression (CNC) framework, which leverages highly efficient context models to provide a storage-friendly NeRF representation.
GScream: Learning 3D Geometry and Feature Consistent Gaussian Splatting for Object Removal
This paper tackles the intricate challenge of object removal to update the radiance field using the 3D Gaussian Splatting.
Taming Stable Diffusion for Text to 360° Panorama Image Generation
Generative models, e. g., Stable Diffusion, have enabled the creation of photorealistic images from text prompts.
ClusteringSDF: Self-Organized Neural Implicit Surfaces for 3D Decomposition
3D decomposition/segmentation still remains a challenge as large-scale 3D annotated data is not readily available.
HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compression
3D Gaussian Splatting (3DGS) has emerged as a promising framework for novel view synthesis, boasting rapid rendering speed with high fidelity.
Ranked #5 on
Novel View Synthesis
on Tanks and Temples
ObjectSDF++: Improved Object-Compositional Neural Implicit Surfaces
Unlike traditional multi-view stereo approaches, the neural implicit surface-based methods leverage neural networks to represent 3D scenes as signed distance functions (SDFs).
Explicit Correspondence Matching for Generalizable Neural Radiance Fields
The key to our approach lies in the explicitly modeled correspondence matching information, so as to provide the geometry prior to the prediction of NeRF color and density for volume rendering.
Make Your Brief Stroke Real and Stereoscopic: 3D-Aware Simplified Sketch to Portrait Generation
Creating the photo-realistic version of people sketched portraits is useful to various entertainment purposes.
Masked Lip-Sync Prediction by Audio-Visual Contextual Exploitation in Transformers
This requires masking a large percentage of the original image and seamlessly inpainting it with the aid of audio and reference frames.
Audio-Driven Co-Speech Gesture Video Generation
Our key insight is that the co-speech gestures can be decomposed into common motion patterns and subtle rhythmic dynamics.
Object-Compositional Neural Implicit Surfaces
This paper proposes a novel framework, ObjectSDF, to build an object-compositional neural implicit representation with high fidelity in 3D reconstruction and object representation.
EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model
Although significant progress has been made to audio-driven talking face generation, existing methods either neglect facial emotion or cannot be applied to arbitrary subjects.
TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial Editing
In this study, we highlight the importance of interaction in a dual-space GAN for more controllable editing.
Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation
To enhance the quality of synthesized gestures, we develop a contrastive learning strategy based on audio-text alignment for better audio representations.
Ranked #3 on
Gesture Generation
on TED Gesture Dataset
Sem2NeRF: Converting Single-View Semantic Masks to Neural Radiance Fields
In light of recent advances in NeRF-based 3D-aware generative models, we introduce a new task, Semantic-to-NeRF translation, that aims to reconstruct a 3D scene modelled by NeRF, conditioned on one single-view semantic mask as input.
Ranked #1 on
3D-Aware Image Synthesis
on CelebAMask-HQ
Exploring Smoothness and Class-Separation for Semi-supervised Medical Image Segmentation
The pixel-level smoothness forces the model to generate invariant results under adversarial perturbations.
Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generation
Moreover, to enable portrait rendering in one unified neural radiance field, a Torso Deformation module is designed to stabilize the large-scale non-rigid torso motions.
AOT: Appearance Optimal Transport Based Identity Swapping for Forgery Detection
However, due to the lack of Deepfakes datasets with large variance in appearance, which can be hardly produced by recent identity swapping methods, the detection algorithm may fail in this situation.
Ranked #7 on
Visual Object Tracking
on DiDi
Disentangled Representation Learning for 3D Face Shape
In this paper, we present a novel strategy to design disentangled 3D face shape representation.
Alive Caricature from 2D to 3D
Caricature is an art form that expresses subjects in abstract, simple and exaggerated view.
