no code implementations • 9 Oct 2024 • Sebastian G. Gruber, Francis Bach
In this work, we propose a mean-squared error-based risk that enables the comparison and optimization of estimators of squared calibration errors in practical settings.
1 code implementation • 2 Sep 2024 • Sebastian G. Gruber, Pascal Tobias Ziegler, Florian Buettner
The evaluation of image generators remains a challenge due to the limitations of traditional metrics in providing nuanced insights into specific image regions.
no code implementations • 14 Dec 2023 • Teodora Popordanoska, Sebastian G. Gruber, Aleksei Tiulpin, Florian Buettner, Matthew B. Blaschko
Proper scoring rules evaluate the quality of probabilistic predictions, playing an essential role in the pursuit of accurate and well-calibrated models.
1 code implementation • 9 Oct 2023 • Sebastian G. Gruber, Florian Buettner
For example, natural language approaches cannot be transferred to image generation.
1 code implementation • 21 Oct 2022 • Sebastian G. Gruber, Florian Buettner
In this work we introduce a general bias-variance decomposition for proper scores, giving rise to the Bregman Information as the variance term.
2 code implementations • 15 Mar 2022 • Sebastian G. Gruber, Florian Buettner
With model trustworthiness being crucial for sensitive real-world applications, practitioners are putting more and more focus on improving the uncertainty calibration of deep neural networks.