Attributing AUC-ROC to Analyze Binary Classifier Performance

no code implementations • 24 May 2022 • Arya Tafvizi, Besim Avci, Mukund Sundararajan

This observation leads to a simple, efficient attribution technique for examples (example attributions), and for pairs of examples (pair attributions).

Detecting Errors and Estimating Accuracy on Unlabeled Data with Self-training Ensembles

1 code implementation • NeurIPS 2021 • Jiefeng Chen, Frederick Liu, Besim Avci, Xi Wu, YIngyu Liang, Somesh Jha

This observation leads to two challenging tasks: (1) unsupervised accuracy estimation, which aims to estimate the accuracy of a pre-trained classifier on a set of unlabeled test inputs; (2) error detection, which aims to identify mis-classified test inputs.

Guided Integrated Gradients: An Adaptive Path Method for Removing Noise

1 code implementation • CVPR 2021 • Andrei Kapishnikov, Subhashini Venugopalan, Besim Avci, Ben Wedin, Michael Terry, Tolga Bolukbasi

To minimize the effect of this source of noise, we propose adapting the attribution path itself -- conditioning the path not just on the image but also on the model being explained.

Incorporating Priors with Feature Attribution on Text Classification

no code implementations • ACL 2019 • Frederick Liu, Besim Avci

Feature attribution methods, proposed recently, help users interpret the predictions of complex models.

General Classification text-classification +1