Natural Adversarial Examples

16 Jul 2019Dan HendrycksKevin ZhaoSteven BasartJacob SteinhardtDawn Song

We introduce natural adversarial examples -- real-world, unmodified, and naturally occurring examples that cause classifier accuracy to significantly degrade. We curate 7,500 natural adversarial examples and release them in an ImageNet classifier test set that we call ImageNet-A... (read more)

PDF Abstract
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT BENCHMARK
Domain Generalization ImageNet-A ResNet-50 Top-1 accuracy % 0 # 7

Methods used in the Paper