Search Results for author: Ramnath Kumar

Found 5 papers, 3 papers with code

EHI: End-to-end Learning of Hierarchical Index for Efficient Dense Retrieval

no code implementations13 Oct 2023 Ramnath Kumar, Anshul Mittal, Nilesh Gupta, Aditya Kusupati, Inderjit Dhillon, Prateek Jain

Such techniques use a two-stage process: (a) contrastive learning to train a dual encoder to embed both the query and documents and (b) approximate nearest neighbor search (ANNS) for finding similar documents for a given query.

Contrastive Learning Retrieval

Stochastic Re-weighted Gradient Descent via Distributionally Robust Optimization

no code implementations15 Jun 2023 Ramnath Kumar, Kushal Majmundar, Dheeraj Nagaraj, Arun Sai Suggala

We present Re-weighted Gradient Descent (RGD), a novel optimization technique that improves the performance of deep neural networks through dynamic sample importance weighting.

Domain Adaptation Representation Learning +1

Introspective Experience Replay: Look Back When Surprised

1 code implementation7 Jun 2022 Ramnath Kumar, Dheeraj Nagaraj

In reinforcement learning (RL), experience replay-based sampling techniques play a crucial role in promoting convergence by eliminating spurious correlations.

Q-Learning reinforcement-learning +1

The Effect of Diversity in Meta-Learning

1 code implementation27 Jan 2022 Ramnath Kumar, Tristan Deleu, Yoshua Bengio

Recent studies show that task distribution plays a vital role in the meta-learner's performance.

Few-Shot Learning

Boosting Exploration in Multi-Task Reinforcement Learning using Adversarial Networks

1 code implementation27 Jan 2022 Ramnath Kumar, Tristan Deleu, Yoshua Bengio

Our proposed adversarial training regime for Multi-Task Reinforcement Learning (MT-RL) addresses the limitations of conventional training methods in RL, especially in meta-RL environments where the agent faces new tasks.

Decision Making reinforcement-learning +1

Cannot find the paper you are looking for? You can Submit a new open access paper.