Search Results for author:
Found 4 papers, 2 papers with code
Designing monitoring strategies for deployed machine learning algorithms: navigating performativity through a causal lens
When an ML algorithm interacts with its environment, the algorithm can affect the data-generating mechanism and be a major source of bias when evaluating its standalone performance, an issue known as performativity.
Is this model reliable for everyone? Testing for strong calibration
In a well-calibrated risk prediction model, the average predicted probability is close to the true event rate for any given subgroup.
Monitoring machine learning (ML)-based risk prediction algorithms in the presence of confounding medical interventions
Performance monitoring of machine learning (ML)-based risk prediction models in healthcare is complicated by the issue of confounding medical interventions (CMI): when an algorithm predicts a patient to be at high risk for an adverse event, clinicians are more likely to administer prophylactic treatment and alter the very target that the algorithm aims to predict.
Sequential algorithmic modification with test data reuse
Each modification introduces a risk of deteriorating performance and must be validated on a test dataset.
