Search Results for author: Walter Bennette

Found 4 papers, 2 papers with code

Facility Locations Utility for Uncovering Classifier Overconfidence

no code implementations12 Oct 2018 Karsten Maurer, Walter Bennette

Assessing the predictive accuracy of black box classifiers is challenging in the absence of labeled test datasets.

Harnessing Adversarial Distances to Discover High-Confidence Errors

1 code implementation29 Jun 2020 Walter Bennette, Karsten Maurer, Sean Sisti

Through rigorous empirical experimentation, we demonstrate that our Adversarial Distance search discovers high-confidence errors at a rate greater than expected given model confidence.

Image Classification Vocal Bursts Intensity Prediction

Generalized Adversarial Distances to Efficiently Discover Classifier Errors

1 code implementation25 Feb 2021 Walter Bennette, Sally Dufek, Karsten Maurer, Sean Sisti, Bunyod Tusmatov

In this paper we propose a generalization to the Adversarial Distance search that leverages concepts from adversarial machine learning to identify predictions for which a classifier may be overly confident.

Establishing baselines and introducing TernaryMixOE for fine-grained out-of-distribution detection

no code implementations30 Mar 2023 Noah Fleischmann, Walter Bennette, Nathan Inkawhich

Machine learning models deployed in the open world may encounter observations that they were not trained to recognize, and they risk misclassifying such observations with high confidence.

Out-of-Distribution Detection

Cannot find the paper you are looking for? You can Submit a new open access paper.