Multi-Paragraph Reasoning with Knowledge-enhanced Graph Neural Network

6 Nov 2019  ·  Deming Ye, Yankai Lin, Zheng-Hao Liu, Zhiyuan Liu, Maosong Sun ·

Multi-paragraph reasoning is indispensable for open-domain question answering (OpenQA), which receives less attention in the current OpenQA systems. In this work, we propose a knowledge-enhanced graph neural network (KGNN), which performs reasoning over multiple paragraphs with entities. To explicitly capture the entities' relatedness, KGNN utilizes relational facts in knowledge graph to build the entity graph. The experimental results show that KGNN outperforms in both distractor and full wiki settings than baselines methods on HotpotQA dataset. And our further analysis illustrates KGNN is effective and robust with more retrieved paragraphs.

PDF Abstract

Datasets


Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Question Answering HotpotQA KGNN ANS-EM 0.277 # 65
ANS-F1 0.372 # 66
SUP-EM 0.127 # 56
SUP-F1 0.472 # 55
JOINT-EM 0.070 # 57
JOINT-F1 0.247 # 58

Methods