Unsupervised Monocular Depth and Ego-motion Learning with Structure and Semantics

12 Jun 2019  ·  Vincent Casser, Soeren Pirk, Reza Mahjourian, Anelia Angelova ·

We present an approach which takes advantage of both structure and semantics for unsupervised monocular learning of depth and ego-motion. More specifically, we model the motion of individual objects and learn their 3D motion vector jointly with depth and ego-motion. We obtain more accurate results, especially for challenging dynamic scenes not addressed by previous approaches. This is an extended version of Casser et al. [AAAI'19]. Code and models have been open sourced at https://sites.google.com/corp/view/struct2depth.

PDF Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Monocular Depth Estimation KITTI Eigen split unsupervised Struct2Depth M absolute relative error 0.1412 # 39

Methods


No methods listed for this paper. Add relevant methods here