Search Results for author:
Found 7 papers, 3 papers with code
Cost-Sensitive Learning to Defer to Multiple Experts with Workload Constraints
Learning to defer (L2D) aims to improve human-AI collaboration systems by learning how to defer decisions to humans when they are more likely to be correct than an ML classifier.
FiFAR: A Fraud Detection Dataset for Learning to Defer
Financial fraud detection is a high-stakes setting where algorithms and human experts often work in tandem; however, there are no publicly available datasets for L2D concerning this important application of human-AI teaming.
A Case Study on Designing Evaluations of ML Explanations with Simulated User Studies
We hope that this work motivates further study of when and how SimEvals should be used to aid in the design of real-world evaluations.
Turning the Tables: Biased, Imbalanced, Dynamic Tabular Datasets for ML Evaluation
The suite was generated by applying state-of-the-art tabular data generation techniques on an anonymized, real-world bank account opening fraud detection dataset.
FairGBM: Gradient Boosting with Fairness Constraints
Tabular data is prevalent in many high-stakes domains, such as financial services or public policy.
On the Importance of Application-Grounded Experimental Design for Evaluating Explainable ML Methods
Most existing evaluations of explainable machine learning (ML) methods rely on simplifying assumptions or proxies that do not reflect real-world use cases; the handful of more robust evaluations on real-world settings have shortcomings in their design, resulting in limited conclusions of methods' real-world utility.
How can I choose an explainer? An Application-grounded Evaluation of Post-hoc Explanations
We conducted an experiment following XAI Test to evaluate three popular post-hoc explanation methods -- LIME, SHAP, and TreeInterpreter -- on a real-world fraud detection task, with real data, a deployed ML model, and fraud analysts.
Decision Making
Explainable Artificial Intelligence (XAI)
+1
