ReCoRD: Bridging the Gap between Human and Machine Commonsense Reading Comprehension

30 Oct 2018  ·  Sheng Zhang, Xiaodong Liu, Jingjing Liu, Jianfeng Gao, Kevin Duh, Benjamin Van Durme ·

We present a large-scale dataset, ReCoRD, for machine reading comprehension requiring commonsense reasoning. Experiments on this dataset demonstrate that the performance of state-of-the-art MRC systems fall far behind human performance. ReCoRD represents a challenge for future research to bridge the gap between human and machine commonsense reading comprehension. ReCoRD is available at http://nlp.jhu.edu/record.

PDF Abstract

Datasets


Results from the Paper


Results from Other Papers


Task Dataset Model Metric Name Metric Value Rank Source Paper Compare
Common Sense Reasoning ReCoRD DocQA + ELMo F1 46.7 # 33
EM 45.4 # 34

Methods


No methods listed for this paper. Add relevant methods here