Recognition of They/Them as Singular Personal Pronouns in Coreference Resolution
As using they/them as personal pronouns becomes increasingly common in English, it is important that coreference resolution systems work as well for individuals who use personal “they” as they do for those who use gendered personal pronouns. We introduce a new benchmark for coreference resolution systems which evaluates singular personal “they” recognition. Using these WinoNB schemas, we evaluate a number of publicly available coreference resolution systems and confirm their bias toward resolving “they” pronouns as plural.
PDF AbstractDatasets
Introduced in the Paper:
WinoNBUsed in the Paper:
WSC WinoBias GAP Coreference Dataset Winogender Schemas GICoref