Out-of-Distribution Detection

240 papers with code • 42 benchmarks • 15 datasets

Detect out-of-distribution or anomalous examples.

Benchmarks

Add a Result

These leaderboards are used to track progress in Out-of-Distribution Detection

Dataset	Best Model	Compare
CIFAR-100 vs CIFAR-10	DHM	See all
CIFAR-10 vs CIFAR-100	DHM	See all
CIFAR-10	DHM	See all
STL-10	Mixup (Gaussian)	See all
CIFAR-100 vs SVHN	OECC + MD	See all
CIFAR-100	Wide ResNet 40x2	See all
MS-1M vs. IJB-C	ResNeXt50 + FSSD	See all
ImageNet dogs vs ImageNet non-dogs	ResNet34 + FSSD	See all
20 Newsgroups	2-Layered GRU	See all
Fashion-MNIST	PAE	See all
CIFAR-100 vs iSUN	DenseNet-BC-100	See all
CIFAR-100 vs LSUN (C)	ResNet-34	See all
CIFAR-100 vs LSUN (R)	DenseNet-BC-100	See all
CIFAR-100 vs ImageNet (R)	DenseNet-BC-100	See all
CIFAR-100 vs ImageNet (C)	DenseNet-BC-100	See all
CIFAR-100 vs Uniform	DenseNet-BC-100	See all
CIFAR-100 vs Gaussian	DenseNet-BC-100	See all
CIFAR-10 vs SVHN	DenseNet-BC-100	See all
CIFAR-10 vs LSUN (C)	DenseNet-BC-100	See all
SVHN vs LSUN (C)	DenseNet-BC-100	See all
CIFAR-10 vs iSUN	DenseNet-BC-100	See all
CIFAR-10 vs ImageNet (R)	DenseNet-BC-100	See all
CIFAR-10 vs ImageNet (C)	DenseNet-BC-100	See all
CIFAR-10 vs Uniform	DenseNet-BC-100	See all
CIFAR-10 vs Gaussian	DenseNet-BC-100	See all
SVHN vs iSUN	DenseNet-BC-100	See all
SVHN vs LSUN (R)	DenseNet-BC-100	See all
SVHN vs ImageNet (R)	DenseNet-BC-100	See all
SVHN vs ImageNet (C)	DenseNet-BC-100	See all
SVHN vs Uniform	DenseNet-BC-100	See all
SVHN vs Gaussian	DenseNet-BC-100	See all
SVHN vs CIFAR-10	DenseNet-BC-100	See all
SVHN vs CIFAR-100	DenseNet-BC-100	See all
CIFAR-10 vs LSUN (R)	ResNet-34	See all
TREC-NEWS	2-Layered GRU	See all
SST	2-Layered GRU	See all
CIFAR-10 vs CIFAR-10.1	ERD (ResNet18)	See all
CIFAR10	Wide ResNet 40x2	See all
ImageNet-1K vs OpenImage-O	ViM (ViT)	See all
ImageNet-1K vs ImageNet-O	ViM (ViT)	See all
cifar10	Wideresnet 40	See all
cifar100	Wide Resnet 40x2	See all

Show all 42 benchmarks

Collapse benchmarks

Libraries

Use these libraries to find Out-of-Distribution Detection models and implementations

lancopku/avg-avg

5 papers

dlmacedo/entropic-out-of-distributi…

4 papers

kobybibas/pnml_ood_detection

4 papers

guyAmit/GLOD

4 papers

See all 7 libraries.

Datasets

Most implemented papers

Most implemented Social Latest No code

CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features

clovaai/CutMix-PyTorch • • ICCV 2019

Regional dropout strategies have been proposed to enhance the performance of convolutional neural network classifiers.

Paper
Code

A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks

hendrycks/error-detection • • 7 Oct 2016

We consider the two related problems of detecting if an example is misclassified or out-of-distribution.

Paper
Code

Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networks

facebookresearch/odin • • ICLR 2018

We show in a series of experiments that ODIN is compatible with diverse network architectures and datasets.

Paper
Code

Deep Anomaly Detection with Outlier Exposure

hendrycks/outlier-exposure • • ICLR 2019

We also analyze the flexibility and robustness of Outlier Exposure, and identify characteristics of the auxiliary dataset that improve performance.

Paper
Code

A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks

pokaxpoka/deep_Mahalanobis_detector • • NeurIPS 2018

Detecting test samples drawn sufficiently far away from the training distribution statistically or adversarially is a fundamental requirement for deploying a good classifier in many real-world machine learning applications.

Paper
Code