Language Models for Code-switch Detection of te reo Māori and English in a Low-resource Setting

no code implementations • Findings (NAACL) 2022 • Jesin James, Vithya Yogarajan, Isabella Shields, Catherine Watson, Peter Keegan, Keoni Mahelona, Peter-Lucas Jones

We also show that BiLSTM with pre-trained Māori-English sub-word embeddings outperforms large-scale contextual language models such as BERT on down streaming tasks of detecting Māori language.

Transfer Learning Word Embeddings