Multilingual NLP

42 papers with code • 0 benchmarks • 8 datasets

This task has no description! Would you like to contribute one?

Libraries

Use these libraries to find Multilingual NLP models and implementations

Most implemented papers

Unsupervised Cross-lingual Representation Learning at Scale

facebookresearch/XLM ACL 2020

We also present a detailed empirical analysis of the key factors that are required to achieve these gains, including the trade-offs between (1) positive transfer and capacity dilution and (2) the performance of high and low resource languages at scale.

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

xusenlinzy/api-for-open-llm 9 Nov 2022

Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions.

Language-agnostic BERT Sentence Embedding

FreddeFrallan/Multilingual-CLIP ACL 2022

While BERT is an effective method for learning monolingual sentence embeddings for semantic similarity and embedding based transfer learning (Reimers and Gurevych, 2019), BERT based cross-lingual sentence embeddings have yet to be explored.

UQA: Corpus for Urdu Question Answering

sameearif/uqa 2 May 2024

This paper introduces UQA, a novel dataset for question answering and text comprehension in Urdu, a low-resource language with over 70 million native speakers.

MMCR4NLP: Multilingual Multiway Corpora Repository for Natural Language Processing

zhiqu22/adapnoncenter 3 Oct 2017

Multilinguality is gradually becoming ubiquitous in the sense that more and more researchers have successfully shown that using additional languages help improve the results in many Natural Language Processing tasks.

PMIndia -- A Collection of Parallel Corpora of Languages of India

bhaddow/pmindia-crawler 27 Jan 2020

Parallel text is required for building high-quality machine translation (MT) systems, as well as for other multilingual NLP applications.

XeroAlign: Zero-Shot Cross-lingual Transformer Alignment

huawei-noah/noah-research Findings (ACL) 2021

The introduction of pretrained cross-lingual language models brought decisive improvements to multilingual NLP tasks.

What is "Typological Diversity" in NLP?

wpoelman/typ-div 6 Feb 2024

We recommend future work to include an operationalization of 'typological diversity' that empirically justifies the diversity of language samples.

Improving Cross-Lingual Word Embeddings by Meeting in the Middle

yeraidm/meemi EMNLP 2018

Cross-lingual word embeddings are becoming increasingly important in multilingual NLP.