Search Results for author:
Found 40 papers, 17 papers with code
UnCommon Objects in 3D
We introduce Uncommon Objects in 3D (uCO3D), a new object-centric dataset for 3D deep learning and 3D generative AI.
PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models
Text- or image-to-3D generators and 3D scanners can now produce 3D assets with high-quality shapes and textures.
Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materials
We present Meta 3D AssetGen (AssetGen), a significant advancement in text-to-3D generation which produces faithful, high-quality meshes with texture and material control.
Meta 3D Gen
We introduce Meta 3D Gen (3DGen), a new state-of-the-art, fast pipeline for text-to-3D asset generation.
Lightplane: Highly-Scalable Components for Neural 3D Fields
Contemporary 3D research, particularly in reconstruction and generation, heavily relies on 2D images for inputs or supervision.
Animal Avatars: Reconstructing Animatable 3D Animals from Casual Videos
We present a method to build animatable dog avatars from monocular videos.
ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models
In this paper, we present a method that leverages pretrained text-to-image models as a prior, and learn to generate multi-view images in a single denoising process from real-world data.
VGGSfM: Visual Geometry Grounded Deep Structure From Motion
Finally we optimise the cameras and triangulate 3D points via a differentiable bundle adjustment layer.
GOEmbed: Gradient Origin Embeddings for Representation Agnostic 3D Feature Learning
Encoding information from 2D views of an object into a 3D representation is crucial for generalized 3D feature extraction.
Visual Geometry Grounded Deep Structure From Motion
Finally, we optimise the cameras and triangulate 3D points via a differentiable bundle adjustment layer.
HoloFusion: Towards Photo-realistic 3D Generative Modeling
Diffusion-based image generators can now produce high-quality and diverse samples, but their success has yet to fully translate to 3D generation: existing diffusion methods can either generate low-resolution but 3D consistent outputs, or detailed 2D views of 3D objects but with potential structural defects and lacking view consistency or realism.
Replay: Multi-modal Multi-view Acted Videos for Casual Holography
We introduce Replay, a collection of multi-view, multi-modal videos of humans interacting socially.
PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustment
Camera pose estimation is a long-standing computer vision problem that to date often relies on classical methods, such as handcrafted keypoint matching, RANSAC and bundle adjustment.
HoloDiffusion: Training a 3D Diffusion Model using 2D Images
We show that our diffusion models are scalable, train robustly, and are competitive in terms of sample quality and fidelity to existing approaches for 3D generative modeling.
Real-time volumetric rendering of dynamic humans
We present a method for fast 3D reconstruction and real-time rendering of dynamic humans from monocular videos with accompanying parametric body fits.
Self-Supervised Correspondence Estimation via Multiview Registration
To address this, we propose a self-supervised approach for correspondence estimation that learns from multiview consistency in short RGB-D video sequences.
Common Pets in 3D: Dynamic New-View Synthesis of Real-Life Deformable Categories
Obtaining photorealistic reconstructions of objects from sparse views is inherently ambiguous and can only be achieved by learning suitable reconstruction priors.
Nerfels: Renderable Neural Codes for Improved Camera Pose Estimation
This paper presents a framework that combines traditional keypoint-based camera pose optimization with an invertible neural rendering mechanism.
iSDF: Real-Time Neural Signed Distance Fields for Robot Perception
We present iSDF, a continual learning system for real-time signed distance field (SDF) reconstruction.
KeyTr: Keypoint Transporter for 3D Reconstruction of Deformable Objects in Videos
Compared to weaker deformation models, this significantly reduces the reconstruction ambiguity and, for dynamic objects, allows Keypoint Transporter to obtain reconstructions of the quality superior or at least comparable to prior approaches while being much faster and reliant on a pre-trained monocular depth estimator network.
Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstruction
Traditional approaches for learning 3D object categories have been predominantly trained and evaluated on synthetic datasets due to the unavailability of real 3D-annotated category-centric data.
DensePose 3D: Lifting Canonical Surface Maps of Articulated Objects to the Third Dimension
The method learns, in an end-to-end fashion, a soft partition of a given category-specific 3D template mesh into rigid parts together with a monocular reconstruction network that predicts the part motions such that they reproject correctly onto 2D DensePose-like surface annotations of the object.
Augmenting Implicit Neural Shape Representations with Explicit Deformation Fields
Implicit neural representation is a recent approach to learn shape collections as zero level-sets of neural networks, where each shape is represented by a latent code.
NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One Go
We present NeuroMorph, a new neural network architecture that takes as input two 3D shapes and produces in one go, i. e. in a single feed forward pass, a smooth interpolation and point-to-point correspondences between them.
Discovering Relationships between Object Categories via Universal Canonical Maps
Recent work has shown that it is possible to learn a unified dense pose predictor for several categories of related objects.
Unsupervised Learning of 3D Object Categories from Videos in the Wild
Our goal is to learn a deep network that, given a small number of images of an object of a given category, reconstructs it in 3D.
Continuous Surface Embeddings
In this work, we focus on the task of learning and representing dense correspondences in deformable object categories.
RidgeSfM: Structure from Motion via Robust Pairwise Matching Under Depth Uncertainty
Using a set of high-quality sparse keypoint matches, we optimize over the per-frame linear combinations of depth planes and camera poses to form a geometrically consistent cloud of keypoints.
3D Multi-bodies: Fitting Sets of Plausible 3D Human Models to Ambiguous Image Data
We consider the problem of obtaining dense 3D reconstructions of humans from single and partially occluded views.
Ranked #3 on
Multi-Hypotheses 3D Human Pose Estimation
on AH36M
Canonical 3D Deformer Maps: Unifying parametric and non-parametric methods for dense weakly-supervised category reconstruction
We propose the Canonical 3D Deformer Map, a new representation of the 3D shape of common object categories that can be learned from a collection of 2D images of independent objects.
Accelerating 3D Deep Learning with PyTorch3D
We address these challenges by introducing PyTorch3D, a library of modular, efficient, and differentiable operators for 3D deep learning.
PerspectiveNet: A Scene-consistent Image Generator for New View Synthesis in Real Indoor Environments
Given a set of a reference RGBD views of an indoor environment, and a new viewpoint, our goal is to predict the view from that location.
Correlated Uncertainty for Learning Dense Correspondences from Noisy Labels
We show that these models, by understanding uncertainty better, can solve the original DensePose task more accurately, thus setting the new state-of-the-art accuracy in this benchmark.
C3DPO: Canonical 3D Pose Networks for Non-Rigid Structure From Motion
We propose C3DPO, a method for extracting 3D models of deformable objects from 2D keypoint annotations in unconstrained images.
Semi-convolutional Operators for Instance Segmentation
Object detection and instance segmentation are dominated by region-based methods such as Mask RCNN.
Self-supervised Learning of Geometrically Stable Features Through Probabilistic Introspection
Self-supervision can dramatically cut back the amount of manually-labelled data required to train deep neural networks.
Learning 3D Object Categories by Looking Around Them
Traditional approaches for learning 3D object categories use either synthetic data or manual supervision.
AnchorNet: A Weakly Supervised Network to Learn Geometry-sensitive Features For Semantic Matching
Despite significant progress of deep learning in recent years, state-of-the-art semantic matching methods still rely on legacy features such as SIFT or HoG.
Learning the semantic structure of objects from Web supervision
While recent research in image understanding has often focused on recognizing more types of objects, understanding more about the objects is just as important.
Cascaded Sparse Spatial Bins for Efficient and Effective Generic Object Detection
The efficiency is achieved by the use of spatial bins in a novel combination with sparsity-inducing group normalized SVM.
