mt5 is a multilingual variant of T5 that was pre-trained on a new Common Crawl-based dataset covering $101$ languages.
Source: mT5: A massively multilingual pre-trained text-to-text transformerPaper | Code | Results | Date | Stars |
---|
Task | Papers | Share |
---|---|---|
Language Modelling | 15 | 8.06% |
Translation | 12 | 6.45% |
Question Answering | 12 | 6.45% |
Machine Translation | 11 | 5.91% |
Cross-Lingual Transfer | 8 | 4.30% |
XLM-R | 8 | 4.30% |
Natural Language Understanding | 7 | 3.76% |
Abstractive Text Summarization | 7 | 3.76% |
Text Generation | 5 | 2.69% |