Rethinking the Agreement in Human Evaluation Tasks

COLING 2018 Jacopo AmideiPaul PiwekAlistair Willis

Human evaluations are broadly thought to be more valuable the higher the inter-annotator agreement. In this paper we examine this idea... (read more)

PDF Abstract COLING 2018 PDF COLING 2018 Abstract

Results from the Paper

  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods used in the Paper

🤖 No Methods Found Help the community by adding them if they're not listed; e.g. Deep Residual Learning for Image Recognition uses ResNet