Cross-Document Language Modeling
1 papers with code • 2 benchmarks • 1 datasets
Involves pretraining language models to support multi-document NLP tasks.
Source: Cross-Document Language Modeling
Image Credit: Cross-Document Language Modeling
Benchmarks
These leaderboards are used to track progress in Cross-Document Language Modeling
| Trend | Dataset | Best Model | Paper | Code | Compare |
|---|---|---|---|---|---|
|
|||||
|
Multi-News
Most implemented papers
CDLM: Cross-Document Language Modeling
aviclu/cdlm
•
•
Findings (EMNLP) 2021
We introduce a new pretraining approach geared for multi-document language modeling, incorporating two key ideas into the masked language modeling self-supervised objective.
