SQuADShifts
Introduced by Miller et al. in The Effect of Natural Distribution Shift on Question Answering Models
Provides four new test sets for the Stanford Question Answering Dataset (SQuAD) and evaluate the ability of question-answering systems to generalize to new data.
Source: The Effect of Natural Distribution Shift on Question Answering ModelsBenchmarks
| Trend | Task | Dataset Variant | Best Model | Paper | Code |
|---|---|---|---|---|---|
|
squadshifts amazon
|
deepset/roberta-large-squad2
|
|||
|
squadshifts new_wiki
|
deepset/roberta-large-squad2
|
|||
|
squadshifts nyt
|
deepset/roberta-large-squad2
|
|||
|
squadshifts reddit
|
deepset/roberta-large-squad2
|
Papers
| Paper | Code | Results | Date | Stars |
|---|
