Search Results for author:
Found 58 papers, 24 papers with code
NASA Neural Articulated Shape Approximation
Efficient representation of articulated objects such as human bodies is an important problem in computer vision and graphics.
Bayes' Rays: Uncertainty Quantification for Neural Radiance Fields
Neural Radiance Fields (NeRFs) have shown promise in applications like view synthesis and depth estimation, but learning from multiview images faces inherent uncertainties.
Neural Fields with Hard Constraints of Arbitrary Differential Order
While deep learning techniques have become extremely popular for solving a broad range of optimization problems, methods to enforce hard constraints during optimization, particularly on deep neural networks, remain underdeveloped.
Unsupervised Semantic Correspondence Using Stable Diffusion
Text-to-image diffusion models are now capable of generating images that are often indistinguishable from real images.
BlendFields: Few-Shot Example-Driven Facial Modeling
Generating faithful visualizations of human faces requires capturing both coarse and fine-level details of the face geometry and appearance.
CC3D: Layout-Conditioned Generation of Compositional 3D Scenes
In this work, we introduce CC3D, a conditional generative model that synthesizes complex 3D scenes conditioned on 2D semantic scene layouts, trained using single-view images.
RobustNeRF: Ignoring Distractors with Robust Losses
To cope with distractors, we advocate a form of robust estimation for NeRF training, modeling distractors in training data as outliers of an optimization problem.
SparsePose: Sparse-View Camera Pose Regression and Refinement
Camera pose estimation is a key step in standard 3D reconstruction pipelines that operate on a dense set of images of a single object or scene.
OpenScene: 3D Scene Understanding with Open Vocabularies
Traditional 3D scene understanding approaches rely on labeled 3D datasets to train a model for a single task with supervision.
NeuMap: Neural Coordinate Mapping by Auto-Transdecoder for Camera Localization
State-of-the-art feature matching methods require each scene to be stored as a 3D point cloud with per-point features, consuming several gigabytes of storage per scene.
nerf2nerf: Pairwise Registration of Neural Radiance Fields
We introduce a technique for pairwise registration of neural fields that extends classical optimization-based local registration (i. e. ICP) to operate on Neural Radiance Fields (NeRF) -- neural 3D scene representations trained from collections of calibrated images.
CUF: Continuous Upsampling Filters
Neural fields have rapidly been adopted for representing 3D signals, but their application to more classical 2D image-processing has been relatively limited.
Novel View Synthesis with Diffusion Models
We demonstrate that stochastic conditioning significantly improves the 3D consistency of a naive sampler for an image-to-image diffusion model, which involves conditioning on a single fixed view.
Attention Beats Concatenation for Conditioning Neural Fields
Neural fields model signals by mapping coordinate inputs to sampled values.
Volume Rendering Digest (for NeRF)
Neural Radiance Fields employ simple volume rendering as a way to overcome the challenges of differentiating through ray-triangle intersections by leveraging a probabilistic notion of visibility.
MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architectures
Neural Radiance Fields (NeRFs) have demonstrated amazing ability to synthesize images of 3D scenes from novel views.
Ranked #1 on
Novel View Synthesis
on Mip-NeRF 360
NeuralBF: Neural Bilateral Filtering for Top-down Instance Segmentation on Point Clouds
We introduce a method for instance proposal generation for 3D point clouds.
D$^2$NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Video
We introduce Decoupled Dynamic Neural Radiance Field (D$^2$NeRF), a self-supervised approach that takes a monocular video and learns a 3D scene representation which decouples moving objects, including their shadows, from the static background.
Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representation
Our model builds a panoptic radiance field representation of any scene from just color images.
Kubric: A scalable dataset generator
Data is the driving force of machine learning, with the amount and quality of training data often being more important for the performance of a system than architecture and training details.
Neural Dual Contouring
We introduce neural dual contouring (NDC), a new data-driven approach to mesh reconstruction based on dual contouring (DC).
Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulation
Our performance generalizes across both object instances and 6-DoF object poses, and significantly outperforms a recent baseline that relies on 2D descriptors.
CoNeRF: Controllable Neural Radiance Fields
We extend neural 3D representations to allow for intuitive and interpretable user control beyond novel view rendering (i. e. camera control).
Urban Radiance Fields
The goal of this work is to perform 3D reconstruction and novel view synthesis from data captured by scanning platforms commonly deployed for world mapping in urban outdoor environments (e. g., Street View).
NeSF: Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenes
We present NeSF, a method for producing 3D semantic fields from posed RGB images alone.
Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representations
In this work, we propose the Scene Representation Transformer (SRT), a method which processes posed or unposed RGB images of a new area, infers a "set-latent scene representation", and synthesises novel views, all in a single feed-forward pass.
VaxNeRF: Revisiting the Classic for Voxel-Accelerated Neural Radiance Field
We hope VaxNeRF -- a careful combination of a classic technique with a deep method (that arguably replaced it) -- can empower and accelerate new NeRF extensions and applications, with its simplicity, portability, and reliable performance gains.
LOLNeRF: Learn from One Look
We present a method for learning a generative 3D model based on neural radiance fields, trained solely from data with only single views of each object.
MetaPose: Fast 3D Pose from Multiple Views without 3D Supervision
In the era of deep learning, human pose estimation from multiple cameras with unknown calibration has received little attention to date.
Ranked #1 on
3D Human Pose Estimation
on SkiPose
Learning Mesh Representations via Binary Space Partitioning Tree Networks
The network is trained to reconstruct a shape using a set of convexes obtained from a BSP-tree built over a set of planes, where the planes and convexes are both defined by learned network weights.
MIST: Multiple Instance Spatial Transformer
We propose a deep network that can be trained to tackle image reconstruction and classification problems that involve detection of multiple object instances, without any supervision regarding their whereabouts.
Deep Medial Fields
Implicit representations of geometry, such as occupancy fields or signed distance fields (SDF), have recently re-gained popularity in encoding 3D solid shape in a functional form.
Vector Neurons: A General Framework for SO(3)-Equivariant Networks
Invariance and equivariance to the rotation group have been widely discussed in the 3D deep learning community for pointclouds.
COTR: Correspondence Transformer for Matching Across Images
We propose a novel framework for finding correspondences in images based on a deep neural network that, given two images and a query point in one of them, finds its correspondence in the other.
Ranked #1 on
Dense Pixel Correspondence Estimation
on ETH3D
Dense Pixel Correspondence Estimation
Optical Flow Estimation
Human 3D keypoints via spatial uncertainty modeling
We introduce a technique for 3D human keypoint estimation that directly models the notion of spatial uncertainty of a keypoint.
Canonical Capsules: Self-Supervised Capsules in Canonical Pose
We propose a self-supervised capsule architecture for 3D point clouds.
ShapeFlow: Learnable Deformation Flows Among 3D Shapes
Such a space naturally allows the disentanglement of geometric style (coming from the source) and structural pose (conforming to the target).
Unsupervised part representation by Flow Capsules
Capsule networks aim to parse images into a hierarchy of objects, parts and relations.
DeRF: Decomposed Radiance Fields
Moreover, we show that a Voronoi spatial decomposition is preferable for this purpose, as it is provably compatible with the Painter's Algorithm for efficient and GPU-friendly rendering.
Voronoi Convolutional Neural Networks
In this technical report, we investigate extending convolutional neural networks to the setting where functions are not sampled in a grid pattern.
PIE-NET: Parametric Inference of Point Cloud Edges
We introduce an end-to-end learnable technique to robustly identify feature edges in 3D point cloud data.
CoSE: Compositional Stroke Embeddings
We demonstrate qualitatively and quantitatively that our proposed approach is able to model the appearance of individual strokes, as well as the compositional structure of larger diagram drawings.
ShapeFlow: Learnable Deformations Among 3D Shapes
We illustrate the effectiveness of this learned deformation space for various downstream applications, including shape generation via deformation, geometric style transfer, unsupervised learning of a consistent parameterization for entire classes of shapes, and shape interpolation.
Deep Implicit Volume Compression
We describe a novel approach for compressing truncated signed distance fields (TSDF) stored in 3D voxel grids, and their corresponding textures.
NiLBS: Neural Inverse Linear Blend Skinning
In this technical report, we investigate efficient representations of articulated objects (e. g. human bodies), which is an important problem in computer vision and graphics.
VoronoiNet: General Functional Approximators with Local Support
Voronoi diagrams are highly compact representations that are used in various Graphics applications.
NASA: Neural Articulated Shape Approximation
Efficient representation of articulated objects such as human bodies is an important problem in computer vision and graphics.
BSP-Net: Generating Compact Meshes via Binary Space Partitioning
The network is trained to reconstruct a shape using a set of convexes obtained from a BSP-tree built on a set of planes.
MIST: Multiple Instance Spatial Transformer Networks
We propose a deep network that can be trained to tackle image reconstruction and classification problems that involve detection of multiple object instances, without any supervision regarding their whereabouts.
CvxNet: Learnable Convex Decomposition
We introduce a network architecture to represent a low dimensional family of convexes.
ACNe: Attentive Context Normalization for Robust Permutation-Equivariant Learning
Many problems in computer vision require dealing with sparse, unordered data in the form of point clouds.
Volumetric Capture of Humans with a Single RGBD Camera via Semi-Parametric Learning
The key insight is to leverage previously seen "calibration" images of a given user to extrapolate what should be rendered in a novel viewpoint from the data available in the sensor.
Linearized Multi-Sampling for Differentiable Image Transformation
We propose a novel image sampling method for differentiable image transformation in deep neural networks.
MIST: Multiple Instance Spatial Transformer Network
We propose a deep network that can be trained to tackle image reconstruction and classification problems that involve detection of multiple object instances, without any supervision regarding their whereabouts.
Anomaly Detection In Surveillance Videos
Image Reconstruction
Espresso: Efficient Forward Propagation for Binary Deep Neural Networks
Binary Deep Neural Networks (BDNNs) have been shown to be an effective way of achieving this objective.
HandSeg: An Automatically Labeled Dataset for Hand Segmentation from Depth Images
We propose an automatic method for generating high-quality annotations for depth-based hand segmentation, and introduce a large-scale hand segmentation dataset.
Low-Dimensionality Calibration Through Local Anisotropic Scaling for Robust Hand Model Personalization
We present a robust algorithm for personalizing a sphere-mesh tracking model to a user from a collection of depth measurements.
Espresso: Efficient Forward Propagation for BCNNs
In this paper, we show how Convolutional Neural Networks (CNNs) can be implemented using binary representations.
