Depth Estimation
State-of-the-art leaderboards
Subtasks
Greatest papers with code
Depth Prediction Without the Sensors: Leveraging Structure for Unsupervised Learning from Monocular Videos
In this work we address unsupervised learning of scene depth and robot ego-motion where supervision is provided by monocular videos, as cameras are the cheapest, least restrictive and most ubiquitous sensor for robotics. We propose a novel approach which produces higher quality results, is able to model moving objects and is shown to transfer across data domains, e.g. from outdoors to indoor scenes.
Unsupervised Monocular Depth Estimation with Left-Right Consistency
CVPR 2017
• mrharicot/monodepth
• 
Learning based methods have shown very promising results for the task of depth estimation in single images. To overcome this problem, we propose a novel training loss that enforces consistency between the disparities produced relative to both the left and right images, leading to improved performance and robustness compared to existing approaches.
Deeper Depth Prediction with Fully Convolutional Residual Networks
• iro-cp/FCRN-DepthPrediction
•
This paper addresses the problem of estimating the depth map of a scene given a single RGB image. We propose a fully convolutional architecture, encompassing residual learning, to model the ambiguous mapping between monocular images and depth maps.
On the Importance of Stereo for Accurate Depth Estimation: An Efficient Semi-Supervised Deep Neural Network Approach
Despite the progress on monocular depth estimation in recent years, we show that the gap between monocular and stereo depth accuracy remains large$-$a particularly relevant result due to the prevalent reliance upon monocular cameras by vehicles that are expected to be self-driving. Competitive results are shown on the KITTI 2015 stereo dataset.
gvnn: Neural Network Library for Geometric Computer Vision
We introduce gvnn, a neural network library in Torch aimed towards bridging the gap between classic geometric computer vision and deep learning. Inspired by the recent success of Spatial Transformer Networks, we propose several new layers which are often used as parametric transformations on the data in geometric computer vision.
Pyramid Stereo Matching Network
CVPR 2018
• JiaRenChang/PSMNet
• 
Recent work has shown that depth estimation from a stereo pair of images can be formulated as a supervised learning task to be resolved with convolutional neural networks (CNNs). The spatial pyramid pooling module takes advantage of the capacity of global context information by aggregating context in different scales and locations to form a cost volume.
Towards 3D Human Pose Estimation in the Wild: a Weakly-supervised Approach
ICCV 2017
• xingyizhou/pytorch-pose-hg-3d
•
We propose a weakly-supervised transfer learning method that uses mixed 2D and 3D labels in a unified deep neutral network that presents two-stage cascaded structure. Our network augments a state-of-the-art 2D pose estimation sub-network with a 3D depth regression sub-network.
#2 best model for
3D Human Pose Estimation on Human3.6M
Sparse-to-Dense: Depth Prediction from Sparse Depth Samples and a Single Image
• fangchangma/sparse-to-dense
• 
We consider the problem of dense depth prediction from a sparse set of depth measurements and a single RGB image. Since depth estimation from monocular images alone is inherently ambiguous and unreliable, to attain a higher level of robustness and accuracy, we introduce additional sparse depth samples, which are either acquired with a low-resolution depth sensor or computed via visual Simultaneous Localization and Mapping (SLAM) algorithms.
DEPTH ESTIMATION SIMULTANEOUS LOCALIZATION AND MAPPING SUPER RESOLUTION
Parse Geometry from a Line: Monocular Depth Estimation with Partial Laser Observation
• fangchangma/sparse-to-dense
•
Many standard robotic platforms are equipped with at least a fixed 2D laser range finder and a monocular camera. Although those platforms do not have sensors for 3D depth sensing capability, knowledge of depth is an essential part in many robotics activities.
Fast Robust Monocular Depth Estimation for Obstacle Detection with Fully Convolutional Networks
• fangchangma/sparse-to-dense
•
This is often achieved through scene depth estimation, by various means. We propose a novel appearance-based Object Detection system that is able to detect obstacles at very long range and at a very high speed (~300Hz), without making assumptions on the type of motion.