ParaCrawl
Introduced by Ba{\~n}{\'o}n et al. in ParaCrawl: Web-Scale Acquisition of Parallel Corpora
ParaCrawl v.7.1 is a parallel dataset with 41 language pairs primarily aligned with English (39 out of 41) and mined using the parallel-data-crawling tool Bitextor which includes downloading documents, preprocessing and normalization, aligning documents and segments, and filtering noisy data via Bicleaner. ParaCrawl focuses on European languages, but also includes 9 lower-resource, non-European language pairs in v7.1.
Source: Quality at a Glance: An Audit of Web-Crawled Multilingual DatasetsPapers
| Paper | Code | Results | Date | Stars |
|---|
