no code implementations • 25 Jan 2023 • Timo Dimitriadis, Tilmann Gneiting, Alexander I. Jordan, Peter Vogel
Probability forecasts for binary outcomes, often referred to as probabilistic classifiers or confidence scores, are ubiquitous in science and society, and methods for evaluating and comparing them are in great demand.
no code implementations • 7 Aug 2020 • Timo Dimitriadis, Tilmann Gneiting, Alexander I. Jordan
A probability forecast or probabilistic classifier is reliable or calibrated if the predicted probabilities are matched by ex post observed frequencies, as examined visually in reliability diagrams.