1 code implementation • NeurIPS 2023 • Ishaan Gulrajani, Tatsunori B. Hashimoto
On the algorithmic front, we introduce several methodological improvements for the maximum-likelihood training of diffusion language models.
2 code implementations • NeurIPS 2023 • Yann Dubois, Xuechen Li, Rohan Taori, Tianyi Zhang, Ishaan Gulrajani, Jimmy Ba, Carlos Guestrin, Percy Liang, Tatsunori B. Hashimoto
As a demonstration of the research possible in AlpacaFarm, we find that methods that use a reward model can substantially improve over supervised fine-tuning and that our reference PPO implementation leads to a +10% improvement in win-rate against Davinci003.
1 code implementation • 27 May 2022 • Xiang Lisa Li, John Thickstun, Ishaan Gulrajani, Percy Liang, Tatsunori B. Hashimoto
Controlling the behavior of language models (LMs) without re-training is a major open problem in natural language generation.
11 code implementations • ICLR 2021 • Ishaan Gulrajani, David Lopez-Paz
As a first step, we realize that model selection is non-trivial for domain generalization tasks.
Ranked #49 on Domain Generalization on PACS
no code implementations • ICLR 2019 • Ishaan Gulrajani, Colin Raffel, Luke Metz
For many evaluation metrics commonly used as benchmarks for unconditional image generation, trivially memorizing the training set attains a better score than models which are considered state-of-the-art; we consider this problematic.
16 code implementations • 5 Jul 2019 • Martin Arjovsky, Léon Bottou, Ishaan Gulrajani, David Lopez-Paz
We introduce Invariant Risk Minimization (IRM), a learning paradigm to estimate invariant correlations across multiple training distributions.
6 code implementations • ICLR 2019 • Jesse Engel, Kumar Krishna Agrawal, Shuo Chen, Ishaan Gulrajani, Chris Donahue, Adam Roberts
Efficient audio synthesis is an inherently difficult machine learning task, as human perception is sensitive to both global structure and fine-scale waveform coherence.
111 code implementations • NeurIPS 2017 • Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, Aaron Courville
Generative Adversarial Networks (GANs) are powerful generative models, but suffer from training instability.
Ranked #3 on Image Generation on CAT 256x256
4 code implementations • 22 Dec 2016 • Soroush Mehri, Kundan Kumar, Ishaan Gulrajani, Rithesh Kumar, Shubham Jain, Jose Sotelo, Aaron Courville, Yoshua Bengio
In this paper we propose a novel model for unconditional audio generation based on generating one audio sample at a time.
Ranked #1 on Speech Synthesis on Blizzard Challenge 2013
1 code implementation • 15 Nov 2016 • Ishaan Gulrajani, Kundan Kumar, Faruk Ahmed, Adrien Ali Taiga, Francesco Visin, David Vazquez, Aaron Courville
Natural image modeling is a landmark challenge of unsupervised learning.
11 code implementations • 24 Jun 2015 • Ankit Kumar, Ozan .Irsoy, Peter Ondruska, Mohit Iyyer, James Bradbury, Ishaan Gulrajani, Victor Zhong, Romain Paulus, Richard Socher
Most tasks in natural language processing can be cast into question answering (QA) problems over language input.
Ranked #66 on Sentiment Analysis on SST-2 Binary classification