Reading Comprehension
Most current question answering datasets frame the task as reading comprehension where the question is about a paragraph or document and the answer often is a span in the document. The Machine Reading group at UCL also provides an overview of reading comprehension tasks.
State-of-the-art leaderboards
| Trend | Dataset | Best Method | Paper title | Paper | Code | Compare |
|---|---|---|---|---|---|---|
|
Subtasks
Latest papers without code
Reasoning Over Paragraph Effects in Situations
A system is presented a background passage containing at least one of these relations, a novel situation that uses this background, and questions that require reasoning about effects of the relationships in the background passage in the context of the situation.
Quoref: A Reading Comprehension Dataset with Questions Requiring Coreferential Reasoning
Machine comprehension of texts longer than a single sentence often requires coreference resolution.
CFO: A Framework for Building Production NLP Systems
This paper introduces a novel orchestration framework, called CFO (COMPUTATION FLOW ORCHESTRATOR), for building, experimenting with, and deploying interactive NLP (Natural Language Processing) and IR (Information Retrieval) systems to production environments.
INFORMATION RETRIEVAL MACHINE READING COMPREHENSION QUESTION ANSWERING
A Multi-Type Multi-Span Network for Reading Comprehension that Requires Discrete Reasoning
Rapid progress has been made in the field of reading comprehension and question answering, where several systems have achieved human parity in some simplified settings.
XCMRC: Evaluating Cross-lingual Machine Reading Comprehension
Chinese and English are rich-resource language pairs, in order to study low-resource cross-lingual machine reading comprehension (XMRC), besides defining the common XCMRC task which has no restrictions on use of external language resources, we also define the pseudo low-resource XCMRC task by limiting the language resources to be used.
SG-Net: Syntax-Guided Machine Reading Comprehension
In this work, we propose using syntax to guide the text modeling of both passages and questions by incorporating syntactic clues into multi-head attention mechanism to fully fuse information from both global and attended representations.
#3 best model for
Question Answering
on SQuAD2.0
FlowDelta: Modeling Flow Information Gain in Reasoning for Conversational Machine Comprehension
Conversational machine comprehension requires deep understanding of the dialogue flow, and the prior work proposed FlowQA to implicitly model the context representations in reasoning for better understanding.
X-WikiRE: A Large, Multilingual Resource for Relation Extraction as Machine Comprehension
Although the vast majority of knowledge bases KBs are heavily biased towards English, Wikipedias do cover very different topics in different languages.
Reasoning-Driven Question-Answering for Natural Language Understanding
In the second part, we propose two new challenge datasets.
COMMON SENSE REASONING NATURAL LANGUAGE INFERENCE QUESTION ANSWERING READING COMPREHENSION
Incorporating Relation Knowledge into Commonsense Reading Comprehension with Multi-task Learning
This paper focuses on how to take advantage of external relational knowledge to improve machine reading comprehension (MRC) with multi-task learning.
LANGUAGE MODELLING MACHINE READING COMPREHENSION MULTI-TASK LEARNING