PhotoShape: Photorealistic Materials for Large-Scale Shape Collections

26 Sep 2018  ·  Keunhong Park, Konstantinos Rematas, Ali Farhadi, Steven M. Seitz ·

Existing online 3D shape repositories contain thousands of 3D models but lack photorealistic appearance. We present an approach to automatically assign high-quality, realistic appearance models to large scale 3D shape collections... The key idea is to jointly leverage three types of online data -- shape collections, material collections, and photo collections, using the photos as reference to guide assignment of materials to shapes. By generating a large number of synthetic renderings, we train a convolutional neural network to classify materials in real photos, and employ 3D-2D alignment techniques to transfer materials to different parts of each shape model. Our system produces photorealistic, relightable, 3D shapes (PhotoShapes). read more

PDF Abstract

Datasets


Introduced in the Paper:

PhotoShape

Used in the Paper:

ImageNet ShapeNet Chairs

Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods


No methods listed for this paper. Add relevant methods here