Denoising Distantly Supervised Open-Domain Question Answering

ACL 2018 Yankai LinHaozhe JiZhiyuan LiuMaosong Sun

Distantly supervised open-domain question answering (DS-QA) aims to find answers in collections of unlabeled text. Existing DS-QA models usually retrieve related paragraphs from a large-scale corpus and apply reading comprehension technique to extract answers from the most relevant paragraph... (read more)

PDF Abstract

Results from the Paper


TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK LEADERBOARD
Open-Domain Question Answering Quasar Denoising QA EM (Quasar-T) 42.2 # 2
F1 (Quasar-T) 49.3 # 2
Open-Domain Question Answering SearchQA Denoising QA Unigram Acc - # 5
N-gram F1 - # 6
EM 58.8 # 1
F1 64.5 # 2