PreCo: A Large-scale Dataset in Preschool Vocabulary for Coreference Resolution

EMNLP 2018  ·  Hong Chen, Zhenhua Fan, Hao Lu, Alan L. Yuille, Shu Rong ·

We introduce PreCo, a large-scale English dataset for coreference resolution. The dataset is designed to embody the core challenges in coreference, such as entity representation, by alleviating the challenge of low overlap between training and test sets and enabling separated analysis of mention detection and mention clustering. To strengthen the training-test overlap, we collect a large corpus of about 38K documents and 12.4M words which are mostly from the vocabulary of English-speaking preschoolers. Experiments show that with higher training-test overlap, error analysis on PreCo is more efficient than the one on OntoNotes, a popular existing dataset. Furthermore, we annotate singleton mentions making it possible for the first time to quantify the influence that a mention detector makes on coreference resolution performance. The dataset is freely available at https://preschool-lab.github.io/PreCo/.

PDF Abstract EMNLP 2018 PDF EMNLP 2018 Abstract

Code
Add Remove Mark official

No code implementations yet. Submit your code now

Datasets

Introduced in the Paper:

PreCo

Used in the Paper:

SQuAD RACE

Results from the Paper
Edit

  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods
Add Remove

No methods listed for this paper. Add relevant methods here
Contact us on: hello@paperswithcode.com . Papers With Code is a free resource with all data licensed under CC-BY-SA.
Terms Data policy Cookies policy