Multilingual Dataset for Training and Evaluating Diacritics Restoration Systems

Introduced by N{\'a}plava et al. in Diacritics Restoration Using Neural Networks

The dataset contains training and evaluation data for 12 languages: - Vietnamese - Romanian - Latvian - Czech - Polish - Slovak - Irish - Hungarian - French - Turkish - Spanish - Croatian

For each language, one training, one development and one testing set acquired from Wikipedia articles is provided. Moreover, each language dataset contains (substantially larger) training set collected from (general) Web texts. All sets, except for Wikipedia and Web training sets that can contain similar sentences, are disjoint. Data are segmented into sentences which are further word tokenized.


Paper Code Results Date Stars

Dataset Loaders

No data loaders found. You can submit your data loader here.