Search Results for author: Derrick Xin

Found 2 papers, 0 papers with code

Order Matters in the Presence of Dataset Imbalance for Multilingual Learning

no code implementations NeurIPS 2023 Dami Choi, Derrick Xin, Hamid Dadkhahi, Justin Gilmer, Ankush Garg, Orhan Firat, Chih-Kuan Yeh, Andrew M. Dai, Behrooz Ghorbani

In this paper, we empirically study the optimization dynamics of multi-task learning, particularly focusing on those that govern a collection of tasks with significant data imbalance.

Language Modelling Machine Translation +3

Do Current Multi-Task Optimization Methods in Deep Learning Even Help?

no code implementations23 Sep 2022 Derrick Xin, Behrooz Ghorbani, Ankush Garg, Orhan Firat, Justin Gilmer

Recent research has proposed a series of specialized optimization algorithms for deep multi-task models.

Cannot find the paper you are looking for? You can Submit a new open access paper.