Search Results for author: Yann Mathet

Found 6 papers, 0 papers with code

Validity, Agreement, Consensuality and Annotated Data Quality

no code implementations LREC 2022 Anaëlle Baledent, Yann Mathet, Antoine Widlöcher, Christophe Couronne, Jean-Luc Manguin

That inter-annotator agreement measure, which is required to check the reliability of data and the reproducibility of an annotation task, and thus to establish a gold standard, is another thorny problem.

The Agreement Measure γcat a Complement to γ Focused on Categorization of a Continuum

no code implementations CL 2017 Yann Mathet

Agreement on unitizing, where several annotators freely put units of various sizes and categories on a continuum, is difficult to assess because of the simultaneaous discrepancies in positioning and categorizing.

Cannot find the paper you are looking for? You can Submit a new open access paper.