Multilingual NLP
27 papers with code • 0 benchmarks • 3 datasets
Benchmarks
These leaderboards are used to track progress in Multilingual NLP
Datasets
Duolingo STAPLE Shared Task
HumSet
303 Hours - Mixed Speech with Chinese and English Data by Mobile Phone
Most implemented papers
Language-agnostic BERT Sentence Embedding
FreddeFrallan/Multilingual-CLIP
•
•
ACL 2022
While BERT is an effective method for learning monolingual sentence embeddings for semantic similarity and embedding based transfer learning (Reimers and Gurevych, 2019), BERT based cross-lingual sentence embeddings have yet to be explored.
PMIndia -- A Collection of Parallel Corpora of Languages of India
Parallel text is required for building high-quality machine translation (MT) systems, as well as for other multilingual NLP applications.
XeroAlign: Zero-Shot Cross-lingual Transformer Alignment
huawei-noah/noah-research
•
•
Findings (ACL) 2021
The introduction of pretrained cross-lingual language models brought decisive improvements to multilingual NLP tasks.
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
bigscience-workshop/bigscience
•
•
Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions.
MMCR4NLP: Multilingual Multiway Corpora Repository for Natural Language Processing
Multilinguality is gradually becoming ubiquitous in the sense that more and more researchers have successfully shown that using additional languages help improve the results in many Natural Language Processing tasks.
Improving Cross-Lingual Word Embeddings by Meeting in the Middle
Cross-lingual word embeddings are becoming increasingly important in multilingual NLP.
Sequence Tagging with Contextual and Non-Contextual Subword Representations: A Multilingual Evaluation
bheinzerling/subword-sequence-tagging
•
•
ACL 2019
Pretrained contextual and non-contextual subword embeddings have become available in over 250 languages, allowing massively multilingual NLP.
Simultaneous Translation and Paraphrase for Language Education
duolingo/duolingo-sharedtask-2020
•
•
WS 2020
We present the task of Simultaneous Translation and Paraphrasing for Language Education (STAPLE).
fugashi, a Tool for Tokenizing Japanese in Python
Recent years have seen an increase in the number of large-scale multilingual NLP projects.
Manual Clustering and Spatial Arrangement of Verbs for Multilingual Evaluation and Typology Analysis
We present the first evaluation of the applicability of a spatial arrangement method (SpAM) to a typologically diverse language sample, and its potential to produce semantic evaluation resources to support multilingual NLP, with a focus on verb semantics.
