Search Results for author:
Found 36 papers, 23 papers with code
Large-Scale 3D Shape Reconstruction and Segmentation from ShapeNet Core55
We introduce a large-scale 3D shape understanding benchmark using data and annotation from ShapeNet 3D object database.
RigNet: Neural Rigging for Articulated Characters
We present RigNet, an end-to-end automated method for producing animation rigs from input character models.
SceneGraphNet: Neural Message Passing for 3D Indoor Scene Augmentation
In this paper we propose a neural message passing approach to augment an input 3D indoor scene with new objects matching their surroundings.
MakeItTalk: Speaker-Aware Talking-Head Animation
We present a method that generates expressive talking heads from a single facial image with audio as the only input.
SPLATNet: Sparse Lattice Networks for Point Cloud Processing
We present a network architecture for processing point clouds that directly operates on a collection of points represented as a sparse set of samples in a high-dimensional lattice.
Ranked #29 on
Semantic Segmentation
on ScanNet
ASSET: Autoregressive Semantic Scene Editing with Transformers at High Resolutions
We present ASSET, a neural architecture for automatically modifying an input high-resolution image according to a user's edits on its semantic segmentation map.
Neural Contours: Learning to Draw Lines from 3D Shapes
This paper introduces a method for learning to generate line drawings from 3D models.
ParSeNet: A Parametric Surface Fitting Network for 3D Point Clouds
We propose a novel, end-to-end trainable, deep network called ParSeNet that decomposes a 3D point cloud into parametric surface patches, including B-spline patches as well as basic geometric primitives.
3D Shape Segmentation with Projective Convolutional Networks
Our architecture combines image-based Fully Convolutional Networks (FCNs) and surface-based Conditional Random Fields (CRFs) to yield coherent segmentations of 3D shapes.
Morig: Motion-aware rigging of character meshes from point clouds
We present MoRig, a method that automatically rigs character meshes driven by single-view point cloud streams capturing the motion of performing characters.
Predicting Animation Skeletons for 3D Articulated Models via Volumetric Nets
We present a learning method for predicting animation skeletons for input 3D models of articulated characters.
Neural Strokes: Stylized Line Drawing of 3D Shapes
We show that, in contrast to previous image-based methods, the use of a geometric representation of 3D shape and 2D strokes allows the model to transfer important aspects of shape and texture style while preserving contours.
Deep Part Induction from Articulated Object Pairs
In this paper, we explore how the observation of different articulation states provides evidence for part structure and motion of 3D objects.
BuildingNet: Learning to Label 3D Buildings
We introduce BuildingNet: (a) a large-scale dataset of 3D building models whose exteriors are consistently labeled, (b) a graph neural network that labels building meshes by analyzing spatial and structural relations of their geometric primitives.
Ranked #1 on
3D Building Mesh Labeling
on BuildingNet-Mesh
Label-Efficient Learning on Point Clouds using Approximate Convex Decompositions
The problems of shape classification and part segmentation from 3D point clouds have garnered increasing attention in the last few years.
Learning Part Boundaries from 3D Point Clouds
We present a method that detects boundaries of parts in 3D shapes represented as point clouds.
APES: Articulated Part Extraction from Sprite Sheets
Rigged puppets are one of the most prevalent representations to create 2D character animations.
Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidance
We introduce Open3DIS, a novel solution designed to tackle the problem of Open-Vocabulary Instance Segmentation within 3D scenes.
Ranked #1 on
3D Open-Vocabulary Instance Segmentation
on S3DIS
3D Instance Segmentation
3D Open-Vocabulary Instance Segmentation
+4
MvDeCor: Multi-view Dense Correspondence Learning for Fine-grained 3D Segmentation
As a result, the learned 2D representations are view-invariant and geometrically consistent, leading to better generalization when trained on a limited number of labeled shapes compared to alternatives that utilize self-supervision in 2D or 3D alone.
PriFit: Learning to Fit Primitives Improves Few Shot Point Cloud Segmentation
We present PriFit, a semi-supervised approach for label-efficient learning of 3D point cloud segmentation networks.
Cross-Shape Attention for Part Segmentation of 3D Point Clouds
The mechanism assesses both the degree of interaction between points and also mediates feature propagation across shapes, improving the accuracy and consistency of the resulting point-wise feature representations for shape segmentation.
Ranked #1 on
3D Semantic Segmentation
on PartNet
3D Shape Reconstruction from Sketches via Multi-view Convolutional Networks
The decoder converts this representation into depth and normal maps capturing the underlying surface from several output viewpoints.
CSGNet: Neural Shape Parser for Constructive Solid Geometry
In contrast, our model uses a recurrent neural network that parses the input shape in a top-down manner, which is significantly faster and yields a compact and easy-to-interpret sequence of modeling instructions.
High-Resolution Shape Completion Using Deep Neural Networks for Global Structure and Local Geometry Inference
Our method is based on a new deep learning architecture consisting of two sub-networks: a global structure inference network and a local geometry refinement network.
Learning Local Shape Descriptors from Part Correspondences With Multi-view Convolutional Networks
We present a new local descriptor for 3D shapes, directly applicable to a wide range of shape analysis problems such as point correspondences, semantic segmentation, affordance prediction, and shape-to-scan matching.
Multi-view Convolutional Neural Networks for 3D Shape Recognition
A longstanding question in computer vision concerns the representation of 3D shapes for recognition: should 3D shapes be represented with descriptors operating on their native 3D formats, such as voxel grid or polygon mesh, or can they be effectively represented with view-based descriptors?
Ranked #94 on
3D Point Cloud Classification
on ModelNet40
Learning Material-Aware Local Descriptors for 3D Shapes
Unfortunately, only a small fraction of shapes in 3D repositories are labeled with physical mate- rials, posing a challenge for learning methods.
Learning Point Embeddings from Shape Repositories for Few-Shot Segmentation
We present a framework for learning representations of 3D shapes that reflect the information present in this meta data and show that it leads to improved generalization for semantic segmentation tasks.
Neural Shape Parsers for Constructive Solid Geometry
We investigate two architectures for this task --- a vanilla encoder (CNN) - decoder (RNN) and another architecture that augments the encoder with an explicit memory module based on the program execution stack.
VisemeNet: Audio-Driven Animator-Centric Speech Animation
We present a novel deep-learning based approach to producing animator-centric speech motion curves that drive a JALI or standard FACS-based production face-rig, directly from input audio.
Graphics
Projective Urban Texturing
Re-targeting such 2D datasets to 3D geometry is challenging because the underlying shape, size, and layout of the urban structures in the photos do not correspond to the ones in the target meshes.
ANISE: Assembly-based Neural Implicit Surface rEconstruction
Reconstructions can be obtained in two ways: (i) by directly decoding the part latent codes to part implicit functions, then combining them into the final shape; or (ii) by using part latents to retrieve similar part instances in a part database and assembling them in a single shape.
Audio-driven Neural Gesture Reenactment with Video Motion Graphs
We present a method that reenacts a high-quality video with gestures matching a target speech audio.
Machine Learning for Automated Mitral Regurgitation Detection from Cardiac Imaging
Mitral regurgitation (MR) is a heart valve disease with potentially fatal consequences that can only be forestalled through timely diagnosis and treatment.
VecFusion: Vector Font Generation with Diffusion
We present VecFusion, a new neural architecture that can generate vector fonts with varying topological structures and precise control point positions.
GEM3D: GEnerative Medial Abstractions for 3D Shape Synthesis
We introduce GEM3D -- a new deep, topology-aware generative model of 3D shapes.
