Search Results for author: Anton Schäfer

Found 3 papers, 2 papers with code

Language Imbalance Can Boost Cross-lingual Generalisation

2 code implementations11 Apr 2024 Anton Schäfer, Shauli Ravfogel, Thomas Hofmann, Tiago Pimentel, Imanol Schlag

In controlled experiments on perfectly equivalent cloned languages, we observe that the existence of a predominant language during training boosts the performance of less frequent languages and leads to stronger alignment of model representations across languages.

Language Modelling

On the Effect of (Near) Duplicate Subwords in Language Modelling

2 code implementations9 Apr 2024 Anton Schäfer, Thomas Hofmann, Imanol Schlag, Tiago Pimentel

In this paper, we study the impact of near duplicate subwords on LM training efficiency.

Language Modelling

Cannot find the paper you are looking for? You can Submit a new open access paper.