SDFDiff: Differentiable Rendering of Signed Distance Fields for 3D Shape Optimization

We propose SDFDiff, a novel approach for image-based shape optimization using differentiable rendering of 3D shapes represented by signed distance functions (SDFs). Compared to other representations, SDFs have the advantage that they can represent shapes with arbitrary topology, and that they guarantee watertight surfaces. We apply our approach to the problem of multi-view 3D reconstruction, where we achieve high reconstruction quality and can capture complex topology of 3D objects. In addition, we employ a multi-resolution strategy to obtain a robust optimization algorithm. We further demonstrate that our SDF-based differentiable renderer can be integrated with deep learning models, which opens up options for learning approaches on 3D objects without 3D supervision. In particular, we apply our method to single-view 3D reconstruction and achieve state-of-the-art results.

PDF Abstract CVPR 2020 PDF CVPR 2020 Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Single-View 3D Reconstruction ShapeNet DIB-R [5] 3DIoU 0.612 # 6
Single-View 3D Reconstruction ShapeNet NMR [21] 3DIoU 0.6015 # 8
Single-View 3D Reconstruction ShapeNet SoftRas (sil.) [28] 3DIoU 0.6234 # 5
Single-View 3D Reconstruction ShapeNet SoftRas (full) [28] 3DIoU 0.6464 # 3
Single-View 3D Reconstruction ShapeNet Ours 3DIoU 0.6674 # 1

Methods


No methods listed for this paper. Add relevant methods here