CamLessMonoDepth: Monocular Depth Estimation with Unknown Camera Parameters

27 Oct 2021  ·  Sai Shyam Chanduri, Zeeshan Khan Suri, Igor Vozniak, Christian Müller ·

Perceiving 3D information is of paramount importance in many applications of computer vision. Recent advances in monocular depth estimation have shown that gaining such knowledge from a single camera input is possible by training deep neural networks to predict inverse depth and pose, without the necessity of ground truth data. The majority of such approaches, however, require camera parameters to be fed explicitly during training. As a result, image sequences from wild cannot be used during training. While there exist methods which also predict camera intrinsics, their performance is not on par with novel methods taking camera parameters as input. In this work, we propose a method for implicit estimation of pinhole camera intrinsics along with depth and pose, by learning from monocular image sequences alone. In addition, by utilizing efficient sub-pixel convolutions, we show that high fidelity depth estimates can be obtained. We also embed pixel-wise uncertainty estimation into the framework, to emphasize the possible applicability of this work in practical domain. Finally, we demonstrate the possibility of accurate prediction of depth information without prior knowledge of camera intrinsics, while outperforming the existing state-of-the-art approaches on KITTI benchmark.

PDF Abstract

Datasets


Introduced in the Paper:

CamlessVideosFromTheWild

Used in the Paper:

KITTI
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Monocular Depth Estimation KITTI Eigen split unsupervised CamLessMonoDepth (V2)-640x192 absolute relative error 0.106 # 26
Monocular Depth Estimation KITTI Eigen split unsupervised CamLessMonoDepth (V1)-640x192 absolute relative error 0.105 # 24
Monocular Depth Estimation KITTI Eigen split unsupervised CamLessMonoDepth-1024x320 absolute relative error 0.102 # 17

Methods


No methods listed for this paper. Add relevant methods here