Search Results for author: Paul Resnick

Found 3 papers, 1 papers with code

Spot Check Equivalence: an Interpretable Metric for Information Elicitation Mechanisms

no code implementations21 Feb 2024 Shengwei Xu, Yichi Zhang, Paul Resnick, Grant Schoenebeck

However, different metrics lead to divergent and even contradictory results in various contexts.

Survey Equivalence: A Procedure for Measuring Classifier Accuracy Against Human Labels

1 code implementation2 Jun 2021 Paul Resnick, Yuqing Kong, Grant Schoenebeck, Tim Weninger

We refer to such tasks as survey settings because the ground truth is defined through a survey of one or more human raters.

Cannot find the paper you are looking for? You can Submit a new open access paper.