On the Usefulness of the Fit-on-the-Test View on Evaluating Calibration of Classifiers

1 code implementation • 16 Mar 2022 • Markus Kängsepp, Kaspar Valk, Meelis Kull

This motivates the fit-on-the-test view on evaluation: first, approximate a calibration map on the test data, and second, quantify its distance from the identity.

Benchmarking