Confidence-based Estimators for Predictive Performance in Model Monitoring

no code implementations • 11 Jul 2024 • Juhani Kivimäki, Jakub Białek, Jukka K. Nurminen, Wojtek Kuberski

For this to be possible, the ground truth labels must be available relatively soon after inference.

Estimating Model Performance Under Covariate Shift Without Labels

no code implementations • 16 Jan 2024 • Jakub Białek, Wojtek Kuberski, Nikolaos Perrakis, Albert Bifet

It is model and data-type agnostic and works for various performance metrics.