no code implementations • 12 Feb 2024 • Jamelle Watson-Daniels, Flavio du Pin Calmon, Alexander D'Amour, Carol Long, David C. Parkes, Berk Ustun
And we characterize expected churn over model updates via the Rashomon set, pairing our analysis with empirical results on real-world datasets -- showing how our approach can be used to better anticipate, reduce, and avoid churn in consumer-facing applications.
1 code implementation • 2 Jun 2022 • Hsiang Hsu, Flavio du Pin Calmon
Predictive multiplicity occurs when classification models with statistically indistinguishable performances assign conflicting predictions to individual samples.
no code implementations • 17 Oct 2019 • Hsiang Hsu, Shahab Asoodeh, Flavio du Pin Calmon
The core of this mechanism relies on a data-driven estimate of the trimmed information density for which we propose a novel estimator, named the trimmed information density estimator (TIDE).
3 code implementations • ICML 2020 • Charles T. Marx, Flavio du Pin Calmon, Berk Ustun
We apply our tools to measure predictive multiplicity in recidivism prediction problems.
no code implementations • 31 May 2019 • Dennis Wei, Karthikeyan Natesan Ramamurthy, Flavio du Pin Calmon
We derive a closed-form expression for the optimal transformed scores and a convex optimization problem for the transformation parameters.