Search Results for author:
Found 41 papers, 16 papers with code
NASA Neural Articulated Shape Approximation
Efficient representation of articulated objects such as human bodies is an important problem in computer vision and graphics.
Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representation
Our model builds a panoptic radiance field representation of any scene from just color images.
Kubric: A scalable dataset generator
Data is the driving force of machine learning, with the amount and quality of training data often being more important for the performance of a system than architecture and training details.
Neural Dual Contouring
We introduce neural dual contouring (NDC), a new data-driven approach to mesh reconstruction based on dual contouring (DC).
Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulation
Our performance generalizes across both object instances and 6-DoF object poses, and significantly outperforms a recent baseline that relies on 2D descriptors.
CoNeRF: Controllable Neural Radiance Fields
We extend neural 3D representations to allow for intuitive and interpretable user control beyond novel view rendering (i. e. camera control).
Urban Radiance Fields
The goal of this work is to perform 3D reconstruction and novel view synthesis from data captured by scanning platforms commonly deployed for world mapping in urban outdoor environments (e. g., Street View).
VaxNeRF: Revisiting the Classic for Voxel-Accelerated Neural Radiance Field
We hope VaxNeRF -- a careful combination of a classic technique with a deep method (that arguably replaced it) -- can empower and accelerate new NeRF extensions and applications, with its simplicity, portability, and reliable performance gains.
NeSF: Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenes
We present NeSF, a method for producing 3D semantic fields from posed RGB images alone.
Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representations
In this work, we propose the Scene Representation Transformer (SRT), a method which processes posed or unposed RGB images of a new area, infers a "set-latent scene representation", and synthesises novel views, all in a single feed-forward pass.
LOLNeRF: Learn from One Look
We present a method for learning a generative 3D model based on neural radiance fields, trained solely from data with only single views of each object.
MetaPose: Fast 3D Pose from Multiple Views without 3D Supervision
In the era of deep learning, human pose estimation from multiple cameras with unknown calibration has received little attention to date.
Learning Mesh Representations via Binary Space Partitioning Tree Networks
The network is trained to reconstruct a shape using a set of convexes obtained from a BSP-tree built over a set of planes, where the planes and convexes are both defined by learned network weights.
MIST: Multiple Instance Spatial Transformer
We propose a deep network that can be trained to tackle image reconstruction and classification problems that involve detection of multiple object instances, without any supervision regarding their whereabouts.
Deep Medial Fields
Implicit representations of geometry, such as occupancy fields or signed distance fields (SDF), have recently re-gained popularity in encoding 3D solid shape in a functional form.
Vector Neurons: A General Framework for SO(3)-Equivariant Networks
Invariance and equivariance to the rotation group have been widely discussed in the 3D deep learning community for pointclouds.
COTR: Correspondence Transformer for Matching Across Images
We propose a novel framework for finding correspondences in images based on a deep neural network that, given two images and a query point in one of them, finds its correspondence in the other.
Ranked #1 on
Dense Pixel Correspondence Estimation
on ETH3D
Dense Pixel Correspondence Estimation
Optical Flow Estimation
Human 3D keypoints via spatial uncertainty modeling
We introduce a technique for 3D human keypoint estimation that directly models the notion of spatial uncertainty of a keypoint.
Canonical Capsules: Self-Supervised Capsules in Canonical Pose
We propose a self-supervised capsule architecture for 3D point clouds.
ShapeFlow: Learnable Deformation Flows Among 3D Shapes
Such a space naturally allows the disentanglement of geometric style (coming from the source) and structural pose (conforming to the target).
Unsupervised part representation by Flow Capsules
Capsule networks aim to parse images into a hierarchy of objects, parts and relations.
DeRF: Decomposed Radiance Fields
Moreover, we show that a Voronoi spatial decomposition is preferable for this purpose, as it is provably compatible with the Painter's Algorithm for efficient and GPU-friendly rendering.
Voronoi Convolutional Neural Networks
In this technical report, we investigate extending convolutional neural networks to the setting where functions are not sampled in a grid pattern.
PIE-NET: Parametric Inference of Point Cloud Edges
We introduce an end-to-end learnable technique to robustly identify feature edges in 3D point cloud data.
CoSE: Compositional Stroke Embeddings
We demonstrate qualitatively and quantitatively that our proposed approach is able to model the appearance of individual strokes, as well as the compositional structure of larger diagram drawings.
ShapeFlow: Learnable Deformations Among 3D Shapes
We illustrate the effectiveness of this learned deformation space for various downstream applications, including shape generation via deformation, geometric style transfer, unsupervised learning of a consistent parameterization for entire classes of shapes, and shape interpolation.
Deep Implicit Volume Compression
We describe a novel approach for compressing truncated signed distance fields (TSDF) stored in 3D voxel grids, and their corresponding textures.
NiLBS: Neural Inverse Linear Blend Skinning
In this technical report, we investigate efficient representations of articulated objects (e. g. human bodies), which is an important problem in computer vision and graphics.
VoronoiNet: General Functional Approximators with Local Support
Voronoi diagrams are highly compact representations that are used in various Graphics applications.
NASA: Neural Articulated Shape Approximation
Efficient representation of articulated objects such as human bodies is an important problem in computer vision and graphics.
BSP-Net: Generating Compact Meshes via Binary Space Partitioning
The network is trained to reconstruct a shape using a set of convexes obtained from a BSP-tree built on a set of planes.
MIST: Multiple Instance Spatial Transformer Networks
We propose a deep network that can be trained to tackle image reconstruction and classification problems that involve detection of multiple object instances, without any supervision regarding their whereabouts.
CvxNet: Learnable Convex Decomposition
We introduce a network architecture to represent a low dimensional family of convexes.
ACNe: Attentive Context Normalization for Robust Permutation-Equivariant Learning
Many problems in computer vision require dealing with sparse, unordered data in the form of point clouds.
Volumetric Capture of Humans with a Single RGBD Camera via Semi-Parametric Learning
The key insight is to leverage previously seen "calibration" images of a given user to extrapolate what should be rendered in a novel viewpoint from the data available in the sensor.
Linearized Multi-Sampling for Differentiable Image Transformation
We propose a novel image sampling method for differentiable image transformation in deep neural networks.
MIST: Multiple Instance Spatial Transformer Network
We propose a deep network that can be trained to tackle image reconstruction and classification problems that involve detection of multiple object instances, without any supervision regarding their whereabouts.
Anomaly Detection In Surveillance Videos
Image Reconstruction
Espresso: Efficient Forward Propagation for Binary Deep Neural Networks
Binary Deep Neural Networks (BDNNs) have been shown to be an effective way of achieving this objective.
HandSeg: An Automatically Labeled Dataset for Hand Segmentation from Depth Images
We propose an automatic method for generating high-quality annotations for depth-based hand segmentation, and introduce a large-scale hand segmentation dataset.
Low-Dimensionality Calibration Through Local Anisotropic Scaling for Robust Hand Model Personalization
We present a robust algorithm for personalizing a sphere-mesh tracking model to a user from a collection of depth measurements.
Espresso: Efficient Forward Propagation for BCNNs
In this paper, we show how Convolutional Neural Networks (CNNs) can be implemented using binary representations.
