Watermarking for Out-of-distribution Detection

27 Oct 2022  ·  Qizhou Wang, Feng Liu, Yonggang Zhang, Jing Zhang, Chen Gong, Tongliang Liu, Bo Han ·

Out-of-distribution (OOD) detection aims to identify OOD data based on representations extracted from well-trained deep models. However, existing methods largely ignore the reprogramming property of deep models and thus may not fully unleash their intrinsic strength: without modifying parameters of a well-trained deep model, we can reprogram this model for a new purpose via data-level manipulation (e.g., adding a specific feature perturbation to the data). This property motivates us to reprogram a classification model to excel at OOD detection (a new task), and thus we propose a general methodology named watermarking in this paper. Specifically, we learn a unified pattern that is superimposed onto features of original data, and the model's detection capability is largely boosted after watermarking. Extensive experiments verify the effectiveness of watermarking, demonstrating the significance of the reprogramming property of deep models in OOD detection.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Out-of-Distribution Detection ImageNet-1k vs Places Watermarking (WRN-40-2 w/ MSP) FPR95 70.59 # 20
AUROC 82.03 # 18
Out-of-Distribution Detection ImageNet-1k vs Places Watermarking (WRN-40-2 w/ Energy) FPR95 71.85 # 21
AUROC 79.85 # 19
Out-of-Distribution Detection ImageNet-1k vs Textures Watermarking (WRN-40-2 w/ Energy) FPR95 67.75 # 26
AUROC 80.80 # 25
Out-of-Distribution Detection ImageNet-1k vs Textures Watermarking (WRN-40-2 w/ MSP) FPR95 61.2 # 24
AUROC 84.00 # 23

Methods


No methods listed for this paper. Add relevant methods here