Search Results for author: Aurko Roy

Found 13 papers, 7 papers with code

Hurdles to Progress in Long-form Question Answering

1 code implementation NAACL 2021 Kalpesh Krishna, Aurko Roy, Mohit Iyyer

The task of long-form question answering (LFQA) involves retrieving documents relevant to a given question and using them to generate a paragraph-length answer.

Open-Domain Dialog Open-Domain Question Answering +1

Efficient Content-Based Sparse Attention with Routing Transformers

2 code implementations12 Mar 2020 Aurko Roy, Mohammad Saffar, Ashish Vaswani, David Grangier

This work builds upon two lines of research: it combines the modeling flexibility of prior work on content-based sparse attention with the efficiency gains from approaches based on local, temporal sparse attention.

Image Generation Language Modelling

Unsupervised Paraphrasing without Translation

no code implementations ACL 2019 Aurko Roy, David Grangier

We compare with MT-based approaches on paraphrase identification, generation, and training augmentation.

Machine Translation Paraphrase Identification +1

Towards a better understanding of Vector Quantized Autoencoders

no code implementations ICLR 2019 Aurko Roy, Ashish Vaswani, Niki Parmar, Arvind Neelakantan

Deep neural networks with discrete latent variables offer the promise of better symbolic reasoning, and learning abstractions that are more useful to new tasks.

Knowledge Distillation Machine Translation +1

Understanding and Improving Interpolation in Autoencoders via an Adversarial Regularizer

7 code implementations ICLR 2019 David Berthelot, Colin Raffel, Aurko Roy, Ian Goodfellow

Autoencoders provide a powerful framework for learning compressed representations by encoding all of the information needed to reconstruct a data point in a latent code.

Theory and Experiments on Vector Quantized Autoencoders

2 code implementations28 May 2018 Aurko Roy, Ashish Vaswani, Arvind Neelakantan, Niki Parmar

Deep neural networks with discrete latent variables offer the promise of better symbolic reasoning, and learning abstractions that are more useful to new tasks.

Image Generation Knowledge Distillation +2

Fast Decoding in Sequence Models using Discrete Latent Variables

no code implementations ICML 2018 Łukasz Kaiser, Aurko Roy, Ashish Vaswani, Niki Parmar, Samy Bengio, Jakob Uszkoreit, Noam Shazeer

Finally, we evaluate our model end-to-end on the task of neural machine translation, where it is an order of magnitude faster at decoding than comparable autoregressive models.

Machine Translation Translation

Thermometer Encoding: One Hot Way To Resist Adversarial Examples

no code implementations ICLR 2018 Jacob Buckman, Aurko Roy, Colin Raffel, Ian Goodfellow

It is well known that it is possible to construct "adversarial examples" for neural networks: inputs which are misclassified by the network yet indistinguishable from true data.

Adversarial Patch

10 code implementations27 Dec 2017 Tom B. Brown, Dandelion Mané, Aurko Roy, Martín Abadi, Justin Gilmer

We present a method to create universal, robust, targeted adversarial image patches in the real world.

Reinforcement Learning under Model Mismatch

no code implementations NeurIPS 2017 Aurko Roy, Huan Xu, Sebastian Pokutta

We study reinforcement learning under model misspecification, where we do not have access to the true environment but only to a reasonably close approximation to it.

Q-Learning reinforcement-learning

Hierarchical Clustering via Spreading Metrics

no code implementations NeurIPS 2016 Aurko Roy, Sebastian Pokutta

We also prove that our algorithm returns an $O(\log{n})$-approximate hierarchical clustering for a generalization of this cost function also studied in [arXiv:1510. 05043].

graph partitioning

Cannot find the paper you are looking for? You can Submit a new open access paper.