BARThez is a self-supervised transfer learning model for the French language based on BART. Compared to existing BERT-based French language models such as CamemBERT and FlauBERT, BARThez is well-suited for generative tasks, since not only its encoder but also its decoder is pretrained.
Source: BARThez: a Skilled Pretrained French Sequence-to-Sequence ModelPaper | Code | Results | Date | Stars |
---|
Task | Papers | Share |
---|---|---|
Natural Language Understanding | 1 | 33.33% |
Self-Supervised Learning | 1 | 33.33% |
Text Summarization | 1 | 33.33% |