Search Results for author:
Found 6 papers, 1 papers with code
Crowdsourcing Natural Language Data at Scale: A Hands-On Tutorial
In this tutorial, we present a portion of unique industry experience in efficient natural language data annotation via crowdsourcing shared by both leading researchers and engineers from Yandex.
Latent Distribution Assumption for Unbiased and Consistent Consensus Modelling
We study the problem of aggregation noisy labels.
Aggregation of pairwise comparisons with reduction of biases
Answers to pairwise tasks are known to be affected by the position of items on the screen, however, previous models for aggregation of pairwise comparisons do not focus on modeling such kind of biases.
Criteria of efficiency for conformal prediction
We study optimal conformity measures for various criteria of efficiency of classification in an idealised setting.
Large-scale probabilistic predictors with and without guarantees of validity
This paper studies theoretically and empirically a method of turning machine-learning algorithms into probabilistic predictors that automatically enjoys a property of validity (perfect calibration) and is computationally efficient.
From conformal to probabilistic prediction
This paper proposes a new method of probabilistic prediction, which is based on conformal prediction.
