no code implementations • 19 Dec 2023 • Isidora Chara Tourni, Derry Wijaya
Unsupervised Neural Machine Translation (UNMT) focuses on improving NMT results under the assumption there is no human translated parallel data, yet little work has been done so far in highlighting its advantages compared to supervised methods and analyzing its output in aspects other than translation accuracy.
no code implementations • 30 Nov 2023 • Isidora Chara Tourni, Derry Wijaya
With the advent of the Transformer architecture, Neural Machine Translation (NMT) results have shown great improvement lately.
no code implementations • 18 Oct 2023 • Isidora Chara Tourni, Subhajit Naskar
In this work, we examine Task-level MoE's applicability in direct NMT and propose a series of high-performing training and evaluation configurations, through which Task-level MoE-based direct NMT systems outperform bilingual and pivot-based models for a large number of low and high-resource direct pairs, and translation directions.
no code implementations • 24 Mar 2021 • Garry Kuwanto, Afra Feyza Akyürek, Isidora Chara Tourni, Siyang Li, Alexander Gregory Jones, Derry Wijaya
We conduct an empirical study of neural machine translation (NMT) for truly low-resource languages, and propose a training curriculum fit for cases when both parallel training data and compute resource are lacking, reflecting the reality of most of the world's languages and the researchers working on these languages.