no code implementations • 20 May 2022 • Thomas Mortier, Viktor Bengs, Eyke Hüllermeier, Stijn Luca, Willem Waegeman
In this paper, we extend the notion of calibration, which is commonly used to evaluate the validity of the aleatoric uncertainty representation of a single probabilistic classifier, to assess the validity of an epistemic uncertainty representation obtained by sets of probabilistic classifiers.
no code implementations • 13 Mar 2022 • Thomas Mortier, Eyke Hüllermeier, Krzysztof Dembczyński, Willem Waegeman
Set-valued prediction is a well-known concept in multi-class classification.
4 code implementations • 19 Jun 2019 • Thomas Mortier, Marek Wydmuch, Krzysztof Dembczyński, Eyke Hüllermeier, Willem Waegeman
In cases of uncertainty, a multi-class classifier preferably returns a set of candidate classes instead of predicting a single class label with little guarantee.