Crowdsourcing and Aggregating Nested Markable Annotations

ACL 2019 Chris MadgeJuntao YuJon ChamberlainUdo KruschwitzSilviu PaunMassimo Poesio

One of the key steps in language resource creation is the identification of the text segments to be annotated, or markables, which depending on the task may vary from nominal chunks for named entity resolution to (potentially nested) noun phrases in coreference resolution (or mentions) to larger text segments in text segmentation. Markable identification is typically carried out semi-automatically, by running a markable identifier and correcting its output by hand{--}which is increasingly done via annotators recruited through crowdsourcing and aggregating their responses... (read more)

PDF Abstract

Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.