Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimation

ICCV 2021  ·  Gwangbin Bae, Ignas Budvytis, Roberto Cipolla ·

Surface normal estimation from a single image is an important task in 3D scene understanding. In this paper, we address two limitations shared by the existing methods: the inability to estimate the aleatoric uncertainty and lack of detail in the prediction. The proposed network estimates the per-pixel surface normal probability distribution. We introduce a new parameterization for the distribution, such that its negative log-likelihood is the angular loss with learned attenuation. The expected value of the angular error is then used as a measure of the aleatoric uncertainty. We also present a novel decoder framework where pixel-wise multi-layer perceptrons are trained on a subset of pixels sampled based on the estimated uncertainty. The proposed uncertainty-guided sampling prevents the bias in training towards large planar surfaces and improves the quality of prediction, especially near object boundaries and on small structures. Experimental results show that the proposed method outperforms the state-of-the-art in ScanNet and NYUv2, and that the estimated uncertainty correlates well with the prediction error. Code is available at

PDF Abstract ICCV 2021 PDF ICCV 2021 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Surface Normal Estimation GRIT NLL-AngMF Normal (ablation) 49.6 # 1
Normal (test) 50.5 # 1
Surface Normals Estimation NYU Depth v2 Bae et al. % < 11.25 62.2 # 1
% < 22.5 79.3 # 1
% < 30 85.2 # 1
Mean Angle Error 14.9 # 1
RMSE 23.5 # 2
Surface Normal Estimation NYU-Depth V2 Bae et al. Mean Angle Error 14.90 # 1
Surface Normals Estimation ScanNetV2 Bae et al. % < 11.25 71.1 # 1
% < 22.5 85.4 # 1
% < 30 89.8 # 1
Mean Angle Error 11.8 # 1


No methods listed for this paper. Add relevant methods here