Bidirectional Attention Flow for Machine Comprehension

5 Nov 2016Minjoon SeoAniruddha KembhaviAli FarhadiHannaneh Hajishirzi

Machine comprehension (MC), answering a query about a given context paragraph, requires modeling complex interactions between the context and the query. Recently, attention mechanisms have been successfully extended to MC... (read more)

PDF Abstract

Results from the Paper


TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT LEADERBOARD
Question Answering CNN / Daily Mail BiDAF CNN 76.9 # 4
Daily Mail 79.6 # 2
Question Answering MS MARCO BiDaF Baseline Rouge-L 23.96 # 4
BLEU-1 10.64 # 4
Question Answering NarrativeQA BiDAF BLEU-1 33.45 # 7
BLEU-4 15.69 # 7
METEOR 15.68 # 7
Rouge-L 36.74 # 8
Open-Domain Question Answering Quasar BiDAF EM (Quasar-T) 25.9 # 6
F1 (Quasar-T) 28.5 # 5
Question Answering SQuAD1.1 BiDAF (single model) EM 67.974 # 144
F1 77.323 # 147
Question Answering SQuAD1.1 BiDAF (ensemble) EM 73.744 # 109
F1 81.525 # 114
Question Answering SQuAD1.1 dev BIDAF (single) EM 67.7 # 30
F1 77.3 # 33