Multi-Hop Paragraph Retrieval for Open-Domain Question Answering

ACL 2019  ·  Yair Feldman, Ran El-Yaniv ·

This paper is concerned with the task of multi-hop open-domain Question Answering (QA). This task is particularly challenging since it requires the simultaneous performance of textual reasoning and efficient searching. We present a method for retrieving multiple supporting paragraphs, nested amidst a large knowledge base, which contain the necessary evidence to answer a given question. Our method iteratively retrieves supporting paragraphs by forming a joint vector representation of both a question and a paragraph. The retrieval is performed by considering contextualized sentence-level representations of the paragraphs in the knowledge source. Our method achieves state-of-the-art performance over two well-known datasets, SQuAD-Open and HotpotQA, which serve as our single- and multi-hop open-domain QA benchmarks, respectively.

PDF Abstract ACL 2019 PDF ACL 2019 Abstract

Datasets


Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Question Answering HotpotQA MUPPET ANS-EM 0.306 # 58
ANS-F1 0.403 # 60
SUP-EM 0.167 # 49
SUP-F1 0.473 # 54
JOINT-EM 0.109 # 52
JOINT-F1 0.270 # 55

Methods


No methods listed for this paper. Add relevant methods here