Generative and Discriminative Voxel Modeling with Convolutional Neural Networks

15 Aug 2016  ·  Andrew Brock, Theodore Lim, J. M. Ritchie, Nick Weston ·

When working with three-dimensional data, choice of representation is key. We explore voxel-based models, and present evidence for the viability of voxellated representations in applications including shape modeling and object classification. Our key contributions are methods for training voxel-based variational autoencoders, a user interface for exploring the latent space learned by the autoencoder, and a deep convolutional neural network architecture for object classification. We address challenges unique to voxel-based representations, and empirically evaluate our models on the ModelNet benchmark, where we demonstrate a 51.5% relative improvement in the state of the art for object classification.

PDF Abstract

Datasets


Results from the Paper


Ranked #14 on 3D Point Cloud Classification on ModelNet40 (Mean Accuracy metric)

     Get a GitHub badge
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
3D Point Cloud Classification ModelNet40 VRN (multiple views) Mean Accuracy 91.33 # 14
3D Point Cloud Classification ModelNet40 VRN (single view) Mean Accuracy 88.98 # 32

Methods


No methods listed for this paper. Add relevant methods here