Search Results for author: Xavier Garcia

Found 14 papers, 3 papers with code

Unifying Language Learning Paradigms

1 code implementation10 May 2022 Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Xavier Garcia, Dara Bahri, Tal Schuster, Huaixiu Steven Zheng, Neil Houlsby, Donald Metzler

Our model also achieve strong results at in-context learning, outperforming 175B GPT-3 on zero-shot SuperGLUE and tripling the performance of T5-XXL on one-shot summarization.

Information Retrieval Long-range modeling +3

Using natural language prompts for machine translation

no code implementations23 Feb 2022 Xavier Garcia, Orhan Firat

We explore the use of natural language prompts for controlling various aspects of the outputs generated by machine translation models.

Machine Translation Translation

Examining Scaling and Transfer of Language Model Architectures for Machine Translation

no code implementations1 Feb 2022 Biao Zhang, Behrooz Ghorbani, Ankur Bapna, Yong Cheng, Xavier Garcia, Jonathan Shen, Orhan Firat

Natural language understanding and generation models follow one of the two dominant architectural paradigms: language models (LMs) that process concatenated sequences in a single stack of layers, and encoder-decoder models (EncDec) that utilize separate layer stacks for input and output processing.

Language Modelling Machine Translation +2

Towards the Next 1000 Languages in Multilingual Machine Translation: Exploring the Synergy Between Supervised and Self-Supervised Learning

no code implementations9 Jan 2022 Aditya Siddhant, Ankur Bapna, Orhan Firat, Yuan Cao, Mia Xu Chen, Isaac Caswell, Xavier Garcia

While recent progress in massively multilingual MT is one step closer to reaching this goal, it is becoming evident that extending a multilingual MT system simply by training on more parallel data is unscalable, since the availability of labeled data for low-resource and non-English-centric language pairs is forbiddingly limited.

Machine Translation Self-Supervised Learning +1

Few-shot Controllable Style Transfer for Low-Resource Multilingual Settings

no code implementations ACL 2022 Kalpesh Krishna, Deepak Nathani, Xavier Garcia, Bidisha Samanta, Partha Talukdar

When compared to prior work, our model achieves 2-3x better performance in formality transfer and code-mixing addition across seven languages.

Style Transfer Text Anonymization +1

Towards Universality in Multilingual Text Rewriting

no code implementations30 Jul 2021 Xavier Garcia, Noah Constant, Mandy Guo, Orhan Firat

In this work, we take the first steps towards building a universal rewriter: a model capable of rewriting text in any language to exhibit a wide variety of attributes, including styles and languages, while preserving as much of the original semantics as possible.

Translation

Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitution

no code implementations NAACL 2021 Xavier Garcia, Noah Constant, Ankur P. Parikh, Orhan Firat

We propose a straightforward vocabulary adaptation scheme to extend the language capacity of multilingual machine translation models, paving the way towards efficient continual learning for multilingual machine translation.

Continual Learning Machine Translation +1

Machine learning applied in the multi-scale 3D stress modelling

no code implementations25 Aug 2020 Xavier Garcia, Adrian Rodriguez-Herrera

One low-frequency solution is obtained via inexpensive finite element modeling at a coarse scale.

A Multilingual View of Unsupervised Machine Translation

no code implementations Findings of the Association for Computational Linguistics 2020 Xavier Garcia, Pierre Foret, Thibault Sellam, Ankur P. Parikh

We present a probabilistic framework for multilingual neural machine translation that encompasses supervised and unsupervised setups, focusing on unsupervised translation.

Translation Unsupervised Machine Translation

Cannot find the paper you are looking for? You can Submit a new open access paper.