Search Results for author:
Found 4 papers, 3 papers with code
Measuring Cross-lingual Transfer in Bytes
We also found evidence that this transfer is not related to language contamination or language proximity, which strengthens the hypothesis that the model also relies on language-agnostic knowledge.
MonoByte: A Pool of Monolingual Byte-level Language Models
The zero-shot cross-lingual ability of models pretrained on multilingual and even monolingual corpora has spurred many hypotheses to explain this intriguing empirical result.
On the ability of monolingual models to learn language-agnostic representations
Pretrained multilingual models have become a de facto default approach for zero-shot cross-lingual transfer.
A cost-benefit analysis of cross-lingual transfer methods
An effective method for cross-lingual transfer is to fine-tune a bilingual or multilingual model on a supervised dataset in one language and evaluating it on another language in a zero-shot manner.
