SberQuAD (Sberbank Question Answering Dataset)
Introduced by Efimov et al. in SberQuAD -- Russian Reading Comprehension Dataset: Description and Analysis
A large scale analogue of Stanford SQuAD in the Russian language - is a valuable resource that has not been properly presented to the scientific community.
See DeepPavlov link
Model results
| Model config | EM (dev) | F-1 (dev) |
|---|---|---|
| DeepPavlov RuBERT | 66.30+-0.24 | 84.60+-0.11 |
| DeepPavlov multilingual BERT | 64.35+-0.39 | 83.39+-0.08 |
| DeepPavlov R-Net | 60.62 | 80.04 |
Benchmarks
| Trend | Task | Dataset Variant | Best Model | Paper | Code |
|---|---|---|---|---|---|
|
SberQuAD
|
DeepPavlov RuBERT
|
Papers
| Paper | Code | Results | Date | Stars |
|---|
