Cross-Lingual Transfer Edit Task
Natural Language Processing • Cross-Lingual
About
Cross-lingual transfer refers to transfer learning using data and models available for one language for which ample such resources are available (e.g., English) to solve tasks in another, commonly more low-resource, language.
Benchmarks
| TREND | DATASET | BEST METHOD | PAPER TITLE | PAPER | CODE | COMPARE |
|---|---|---|---|---|---|---|
|
Subtasks
Datasets
Greatest papers with code
Unsupervised Cross-lingual Representation Learning at Scale
ACL 2020
• huggingface/transformers
• 
We also present a detailed empirical analysis of the key factors that are required to achieve these gains, including the trade-offs between (1) positive transfer and capacity dilution and (2) the performance of high and low resource languages at scale.
CROSS-LINGUAL TRANSFER LANGUAGE MODELLING REPRESENTATION LEARNING
Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond
TACL 2019
• facebookresearch/LASER
•
We introduce an architecture to learn joint multilingual sentence representations for 93 languages, belonging to more than 30 different families and written in 28 different scripts.
CROSS-LINGUAL BITEXT MINING CROSS-LINGUAL DOCUMENT CLASSIFICATION CROSS-LINGUAL NATURAL LANGUAGE INFERENCE CROSS-LINGUAL TRANSFER DOCUMENT CLASSIFICATION JOINT MULTILINGUAL SENTENCE REPRESENTATIONS PARALLEL CORPUS MINING
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training
In this work, we present an information-theoretic framework that formulates cross-lingual language model pre-training as maximizing mutual information between multilingual-multi-granularity texts.
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation
However, these broad-coverage benchmarks have been mostly limited to English, and despite an increasing interest in multilingual models, a benchmark that enables the comprehensive evaluation of such methods on a diverse range of languages and tasks is still missing.
XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation
Machine learning has brought striking advances in multilingual natural language processing capabilities over the past year.
CROSS-LINGUAL TRANSFER NATURAL LANGUAGE UNDERSTANDING TRANSFER LEARNING
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization
However, these broad-coverage benchmarks have been mostly limited to English, and despite an increasing interest in multilingual models, a benchmark that enables the comprehensive evaluation of such methods on a diverse range of languages and tasks is still missing.
Don't Just Scratch the Surface: Enhancing Word Representations for Korean with Hanja
We propose a simple yet effective approach for improving Korean word representations using additional linguistic annotation (i. e. Hanja).
Cross-Lingual Natural Language Generation via Pre-Training
• CZWin32768/xnlg
•
In this work we focus on transferring supervision signals of natural language generation (NLG) tasks between multiple languages.
ABSTRACTIVE TEXT SUMMARIZATION CROSS-LINGUAL TRANSFER MACHINE TRANSLATION QUESTION GENERATION TEXT GENERATION
Word Alignment by Fine-tuning Embeddings on Parallel Corpora
In addition, we demonstrate that we are able to train multilingual word aligners that can obtain robust performance on different language pairs.
UniTrans: Unifying Model Transfer and Data Transfer for Cross-Lingual Named Entity Recognition with Unlabeled Data
Prior works in cross-lingual named entity recognition (NER) with no/little labeled data fall into two primary categories: model transfer based and data transfer based methods.
Ranked #1 on
Cross-Lingual NER
on CoNLL Spanish
CROSS-LINGUAL NER KNOWLEDGE DISTILLATION NAMED ENTITY RECOGNITION