TASK	DATASET	MODEL	METRIC NAME	METRIC VALUE	GLOBAL RANK
Dependency Parsing	French GSD	CamemBERT	LAS	92.47	# 1
Dependency Parsing	French GSD	CamemBERT	UAS	94.82	# 1
Part-Of-Speech Tagging	French GSD	CamemBERT	UPOS	98.19	# 1
Named Entity Recognition	French Treebank	CamemBERT (subword masking)	F1	87.93	# 1
Named Entity Recognition	French Treebank	CamemBERT (subword masking)	Precision	88.35	# 1
Named Entity Recognition	French Treebank	CamemBERT (subword masking)	Recall	87.46	# 1
Part-Of-Speech Tagging	ParTUT	CamemBERT	UPOS	97.63	# 1
Dependency Parsing	ParTUT	CamemBERT	LAS	92.9	# 1
Dependency Parsing	ParTUT	CamemBERT	UAS	95.21	# 1
Part-Of-Speech Tagging	Sequoia Treebank	CamemBERT	UPOS	99.21	# 1
Dependency Parsing	Sequoia Treebank	CamemBERT	LAS	94.39	# 1
Dependency Parsing	Sequoia Treebank	CamemBERT	UAS	95.56	# 1
Dependency Parsing	Spoken Corpus	CamemBERT	LAS	81.37	# 1
Dependency Parsing	Spoken Corpus	CamemBERT	UAS	86.05	# 1
Part-Of-Speech Tagging	Spoken Corpus	CamemBERT	UPOS	96.68	# 1
Natural Language Inference	XNLI French	CamemBERT	Accuracy	81.2	# 1

🦡 Badges

Include the markdown at the top of your GitHub README.md file to showcase the performance of the model.

Badges are live and will be dynamically updated with the latest ranking of this paper.

Badge	Markdown
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/camembert-a-tasty-french-language-model/dependency-parsing-on-french-gsd)](https://paperswithcode.com/sota/dependency-parsing-on-french-gsd?p=camembert-a-tasty-french-language-model)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/camembert-a-tasty-french-language-model/part-of-speech-tagging-on-french-gsd)](https://paperswithcode.com/sota/part-of-speech-tagging-on-french-gsd?p=camembert-a-tasty-french-language-model)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/camembert-a-tasty-french-language-model/named-entity-recognition-on-french-treebank)](https://paperswithcode.com/sota/named-entity-recognition-on-french-treebank?p=camembert-a-tasty-french-language-model)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/camembert-a-tasty-french-language-model/part-of-speech-tagging-on-partut)](https://paperswithcode.com/sota/part-of-speech-tagging-on-partut?p=camembert-a-tasty-french-language-model)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/camembert-a-tasty-french-language-model/dependency-parsing-on-partut)](https://paperswithcode.com/sota/dependency-parsing-on-partut?p=camembert-a-tasty-french-language-model)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/camembert-a-tasty-french-language-model/part-of-speech-tagging-on-sequoia-treebank)](https://paperswithcode.com/sota/part-of-speech-tagging-on-sequoia-treebank?p=camembert-a-tasty-french-language-model)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/camembert-a-tasty-french-language-model/dependency-parsing-on-sequoia-treebank)](https://paperswithcode.com/sota/dependency-parsing-on-sequoia-treebank?p=camembert-a-tasty-french-language-model)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/camembert-a-tasty-french-language-model/dependency-parsing-on-spoken-corpus)](https://paperswithcode.com/sota/dependency-parsing-on-spoken-corpus?p=camembert-a-tasty-french-language-model)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/camembert-a-tasty-french-language-model/part-of-speech-tagging-on-spoken-corpus)](https://paperswithcode.com/sota/part-of-speech-tagging-on-spoken-corpus?p=camembert-a-tasty-french-language-model)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/camembert-a-tasty-french-language-model/natural-language-inference-on-xnli-french)](https://paperswithcode.com/sota/natural-language-inference-on-xnli-french?p=camembert-a-tasty-french-language-model)`

CamemBERT: a Tasty French Language Model

ACL 2020 • Louis Martin • Benjamin Muller • Pedro Javier Ortiz Suárez • Yoann Dupont • Laurent Romary • Éric Villemonte de la Clergerie • Djamé Seddah • Benoît Sagot

Pretrained language models are now ubiquitous in Natural Language Processing. Despite their success, most available models have either been trained on English data or on the concatenation of data in multiple languages... (read more)

PDF Abstract ACL 2020 PDF ACL 2020 Abstract

Code

Add Remove Mark official

huggingface/transformers official

43,661

Karthik-Bhaskar/Context-Based-Question-Answering

anaishoareau/french_preprocessing

bourrel/French-News-Clustering

hbaflast/bert-sentiment-analysis-pytorch

See all 6 implementations

Tasks

Add Remove

DEPENDENCY PARSING

LANGUAGE MODELLING

NAMED ENTITY RECOGNITION

NATURAL LANGUAGE INFERENCE

PART-OF-SPEECH TAGGING

Datasets

Introduced in the Paper:

French Wikipedia

Mentioned in the Paper:

MultiNLI

XNLI CCNet FQuAD

XTREME

Results from the Paper

Edit

Ranked #1 on Dependency Parsing on Spoken Corpus

Get a GitHub badge

TASK	DATASET	MODEL	METRIC NAME	METRIC VALUE	GLOBAL RANK	BENCHMARK
Dependency Parsing	French GSD	CamemBERT	LAS	92.47	# 1	Compare
Dependency Parsing	French GSD	CamemBERT	UAS	94.82	# 1	Compare
Part-Of-Speech Tagging	French GSD	CamemBERT	UPOS	98.19	# 1	Compare
Named Entity Recognition	French Treebank	CamemBERT (subword masking)	F1	87.93	# 1	Compare
			Precision	88.35	# 1	Compare
			Recall	87.46	# 1	Compare
Part-Of-Speech Tagging	ParTUT	CamemBERT	UPOS	97.63	# 1	Compare
Dependency Parsing	ParTUT	CamemBERT	LAS	92.9	# 1	Compare
Dependency Parsing	ParTUT	CamemBERT	UAS	95.21	# 1	Compare
Part-Of-Speech Tagging	Sequoia Treebank	CamemBERT	UPOS	99.21	# 1	Compare
Dependency Parsing	Sequoia Treebank	CamemBERT	LAS	94.39	# 1	Compare
Dependency Parsing	Sequoia Treebank	CamemBERT	UAS	95.56	# 1	Compare
Dependency Parsing	Spoken Corpus	CamemBERT	LAS	81.37	# 1	Compare
Dependency Parsing	Spoken Corpus	CamemBERT	UAS	86.05	# 1	Compare
Part-Of-Speech Tagging	Spoken Corpus	CamemBERT	UPOS	96.68	# 1	Compare
Natural Language Inference	XNLI French	CamemBERT	Accuracy	81.2	# 1	Compare

Methods used in the Paper

Add Remove

METHOD	TYPE
🤖 No Methods Found	Help the community by adding them if they're not listed; e.g. Deep Residual Learning for Image Recognition uses ResNet

Edit Social Preview

CamemBERT: a Tasty French Language Model Edit social preview

Code Edit Add Remove Mark official

Tasks Edit Add Remove

Datasets Edit

Results from the Paper Edit

Methods used in the Paper Edit Add Remove