Bidirectional Attention Flow for Machine Comprehension

Machine comprehension (MC), answering a query about a given context paragraph, requires modeling complex interactions between the context and the query. Recently, attention mechanisms have been successfully extended to MC... (read more)

PDF Abstract
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT BENCHMARK
Question Answering CNN / Daily Mail BiDAF CNN 76.9 # 4
Daily Mail 79.6 # 2
Question Answering MS MARCO BiDaF Baseline Rouge-L 23.96 # 4
BLEU-1 10.64 # 4
Question Answering NarrativeQA BiDAF BLEU-1 33.45 # 7
BLEU-4 15.69 # 7
METEOR 15.68 # 7
Rouge-L 36.74 # 8
Open-Domain Question Answering Quasar BiDAF EM (Quasar-T) 25.9 # 6
F1 (Quasar-T) 28.5 # 5
Question Answering SQuAD1.1 BiDAF (single model) EM 67.974 # 160
F1 77.323 # 162
Question Answering SQuAD1.1 BiDAF (ensemble) EM 73.744 # 124
F1 81.525 # 129
Question Answering SQuAD1.1 dev BIDAF (single) EM 67.7 # 34
F1 77.3 # 37

Methods used in the Paper


METHOD TYPE
🤖 No Methods Found Help the community by adding them if they're not listed; e.g. Deep Residual Learning for Image Recognition uses ResNet