Language Models

BARThez is a self-supervised transfer learning model for the French language based on BART. Compared to existing BERT-based French language models such as CamemBERT and FlauBERT, BARThez is well-suited for generative tasks, since not only its encoder but also its decoder is pretrained.

Source: BARThez: a Skilled Pretrained French Sequence-to-Sequence Model

Papers


Paper Code Results Date Stars

Tasks


Task Papers Share
Natural Language Understanding 1 33.33%
Self-Supervised Learning 1 33.33%
Text Summarization 1 33.33%

Components


Component Type
BART
Transformers

Categories