Interrater Disagreement Resolution: A Systematic Procedure to Reach Consensus in Annotation Tasks

1 code implementation • EACL (HumEval) 2021 • Yvette Oortwijn, Thijs Ossenkoppele, Arianna Betti

We present a systematic procedure for interrater disagreement resolution.

Ground Truths for the Humanities

no code implementations • 23 Mar 2021 • Yvette Oortwijn, Hein van den Berg, Arianna Betti

Ensuring a faithful interaction with data and its representation for humanities can and should depend on expert-constructed ground truths.

Expert Concept-Modeling Ground Truth Construction for Word Embeddings Evaluation in Concept-Focused Domains

2 code implementations • COLING 2020 • Arianna Betti, Martin Reynaert, Thijs Ossenkoppele, Yvette Oortwijn, Andrew Salway, Jelke Bloem

We present a novel, domain expert-controlled, replicable procedure for the construction of concept-modeling ground truths with the aim of evaluating the application of word embeddings.

Embeddings Evaluation Philosophy

Distributional Semantics for Neo-Latin

no code implementations • LREC 2020 • Jelke Bloem, Maria Chiara Parisi, Martin Reynaert, Yvette Oortwijn, Arianna Betti

Our results show that consistent Neo-Latin word embeddings can be learned from this type of data.

Word Embeddings