XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages

1 code implementation • 19 May 2023 • Sebastian Ruder, Jonathan H. Clark, Alexander Gutkin, Mihir Kale, Min Ma, Massimo Nicosia, Shruti Rijhwani, Parker Riley, Jean-Michel A. Sarr, Xinyi Wang, John Wieting, Nitish Gupta, Anna Katanova, Christo Kirov, Dana L. Dickinson, Brian Roark, Bidisha Samanta, Connie Tao, David I. Adelani, Vera Axelrod, Isaac Caswell, Colin Cherry, Dan Garrette, Reeve Ingle, Melvin Johnson, Dmitry Panteleev, Partha Talukdar

We evaluate commonly used models on the benchmark.

In-Context Learning Multilingual NLP +3

Improving Yorùbá Diacritic Restoration

1 code implementation • 23 Mar 2020 • Iroro Orife, David I. Adelani, Timi Fasubaa, Victor Williamson, Wuraola Fisayo Oyewusi, Olamilekan Wahab, Kola Tubosun

Yor\`ub\'a is a widely spoken West African language with a writing system rich in orthographic and tonal diacritics.

Massive vs. Curated Word Embeddings for Low-Resourced Languages. The Case of Yorùbá and Twi

1 code implementation • 5 Dec 2019 • Jesujoba O. Alabi, Kwabena Amponsah-Kaakyire, David I. Adelani, Cristina España-Bonet

In this paper we focus on two African languages, Yor\`ub\'a and Twi, and compare the word embeddings obtained in this way, with word embeddings obtained from curated corpora and a language-dependent processing.

Word Embeddings

The Effect of Domain and Diacritics in Yorùbá-English Neural Machine Translation

1 code implementation • 15 Mar 2021 • David I. Adelani, Dana Ruiter, Jesujoba O. Alabi, Damilola Adebonojo, Adesina Ayeni, Mofe Adeyemi, Ayodele Awokoya, Cristina España-Bonet

We investigate how and when this training condition affects the final quality and intelligibility of a translation.

Benchmarking Domain Adaptation +2

MphayaNER: Named Entity Recognition for Tshivenda

1 code implementation • 8 Apr 2023 • Rendani Mbuvha, David I. Adelani, Tendani Mutavhatsindi, Tshimangadzo Rakhuhu, Aluwani Mauda, Tshifhiwa Joshua Maumela, Andisani Masindi, Seani Rananga, Vukosi Marivate, Tshilidzi Marwala

Named Entity Recognition (NER) plays a vital role in various Natural Language Processing tasks such as information retrieval, text classification, and question answering.

Information Retrieval named-entity-recognition +6

AI4D -- African Language Program

1 code implementation • 6 Apr 2021 • Kathleen Siminyu, Godson Kalipe, Davor Orlic, Jade Abbott, Vukosi Marivate, Sackey Freshia, Prateek Sibal, Bhanu Neupane, David I. Adelani, Amelia Taylor, Jamiil Toure Ali, Kevin Degila, Momboladji Balogoun, Thierno Ibrahima DIOP, Davis David, Chayma Fourati, Hatem Haddad, Malek Naski

Advances in speech and language technologies enable tools such as voice-search, text-to-speech, speech recognition and machine translation.

Machine Translation speech-recognition +2

How good are Large Language Models on African Languages?

no code implementations • 14 Nov 2023 • Jessica Ojo, Kelechi Ogueji, Pontus Stenetorp, David I. Adelani

Our results suggest that all LLMs produce below-par performance on African languages, and there is a large gap in performance compared to high-resource languages like English most tasks.

In-Context Learning Language Modelling +8