Search Results for author: Gantavya Bhatt

Found 4 papers, 4 papers with code

Matryoshka Representations for Adaptive Deployment

1 code implementation26 May 2022 Aditya Kusupati, Gantavya Bhatt, Aniket Rege, Matthew Wallingford, Aditya Sinha, Vivek Ramanujan, William Howard-Snyder, KaiFeng Chen, Sham Kakade, Prateek Jain, Ali Farhadi

The flexibility within the learned Matryoshka Representations offer: (a) up to 14x smaller embedding size for ImageNet-1K classification at the same level of accuracy; (b) up to 14x real-world speed-ups for large-scale retrieval on ImageNet-1K and 4K; and (c) up to 2% accuracy improvements for long-tail few-shot classification, all while being as robust as the original representations.

Ranked #20 on Image Classification on ObjectNet (using extra training data)

Image Classification Representation Learning

Systematic Generalization in Neural Networks-based Multivariate Time Series Forecasting Models

1 code implementation10 Feb 2021 Hritik Bansal, Gantavya Bhatt, Pankaj Malhotra, Prathosh A. P

Systematic generalization aims to evaluate reasoning about novel combinations from known components, an intrinsic property of human cognition.

Inductive Bias Multivariate Time Series Forecasting +2

Can RNNs trained on harder subject-verb agreement instances still perform well on easier ones?

1 code implementation SCiL 2021 Hritik Bansal, Gantavya Bhatt, Sumeet Agarwal

However, we observe that several RNN types, including the ONLSTM which has a soft structural inductive bias, surprisingly fail to perform well on sentences without attractors when trained solely on sentences with attractors.

Inductive Bias

How much complexity does an RNN architecture need to learn syntax-sensitive dependencies?

1 code implementation ACL 2020 Gantavya Bhatt, Hritik Bansal, Rishubh Singh, Sumeet Agarwal

Long short-term memory (LSTM) networks and their variants are capable of encapsulating long-range dependencies, which is evident from their performance on a variety of linguistic tasks.

Ranked #29 on Language Modelling on WikiText-103 (Validation perplexity metric)

Language Modelling

Cannot find the paper you are looking for? You can Submit a new open access paper.