Search Results for author:
Found 3 papers, 0 papers with code
k-Rater Reliability: The Correct Unit of Reliability for Aggregated Human Annotations
In these instances, the data reliability is under-reported, and a proposed k-rater reliability (kRR) should be used as the correct data reliability for aggregated datasets.
Cross-replication Reliability - An Empirical Approach to Interpreting Inter-rater Reliability
When collecting annotations and labeled data from humans, a standard practice is to use inter-rater reliability (IRR) as a measure of data goodness (Hallgren, 2012).
Cross-replication Reliability -- An Empirical Approach to Interpreting Inter-rater Reliability
We present a new approach to interpreting IRR that is empirical and contextualized.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
