Search Results for author: Raghav Somani

Found 13 papers, 3 papers with code

Path convergence of Markov chains on large graphs

no code implementations18 Aug 2023 Siva Athreya, Soumik Pal, Raghav Somani, Raghavendra Tripathi

In both cases we show that, as the size of the graph goes to infinity, the random trajectories of the stochastic processes converge to deterministic curves on the space of measure-valued graphons.

Stochastic Optimization

Stochastic optimization on matrices and a graphon McKean-Vlasov limit

no code implementations2 Oct 2022 Zaid Harchaoui, Sewoong Oh, Soumik Pal, Raghav Somani, Raghavendra Tripathi

The limiting curve of graphons is characterized by a family of stochastic differential equations with reflections and can be thought of as an extension of the classical McKean-Vlasov limit for interacting diffusions.

Stochastic Optimization

Gradient flows on graphons: existence, convergence, continuity equations

no code implementations18 Nov 2021 Sewoong Oh, Soumik Pal, Raghav Somani, Raghavendra Tripathi

Wasserstein gradient flows on probability measures have found a host of applications in various optimization problems.

SPECTRE: Defending Against Backdoor Attacks Using Robust Statistics

1 code implementation22 Apr 2021 Jonathan Hayase, Weihao Kong, Raghav Somani, Sewoong Oh

There have been promising attempts to use the intermediate representations of such a model to separate corrupted examples from clean ones.

Robust Meta-learning for Mixed Linear Regression with Small Batches

no code implementations NeurIPS 2020 Weihao Kong, Raghav Somani, Sham Kakade, Sewoong Oh

Together, this approach is robust against outliers and achieves a graceful statistical trade-off; the lack of $\Omega(k^{1/2})$-size tasks can be compensated for with smaller tasks, which can now be as small as $O(\log k)$.

Meta-Learning regression

Meta-learning for mixed linear regression

no code implementations ICML 2020 Weihao Kong, Raghav Somani, Zhao Song, Sham Kakade, Sewoong Oh

In modern supervised learning, there are a large number of tasks, but many of them are associated with only a small amount of labeled data.

Meta-Learning regression +1

Non-Gaussianity of Stochastic Gradient Noise

no code implementations21 Oct 2019 Abhishek Panigrahi, Raghav Somani, Navin Goyal, Praneeth Netrapalli

What enables Stochastic Gradient Descent (SGD) to achieve better generalization than Gradient Descent (GD) in Neural Network training?

Universality Patterns in the Training of Neural Networks

no code implementations17 May 2019 Raghav Somani, Navin Goyal, Prateek Jain, Praneeth Netrapalli

This paper proposes and demonstrates a surprising pattern in the training of neural networks: there is a one to one relation between the values of any pair of losses (such as cross entropy, mean squared error, 0/1 error etc.)

Support Recovery for Orthogonal Matching Pursuit: Upper and Lower bounds

no code implementations NeurIPS 2018 Raghav Somani, Chirag Gupta, Prateek Jain, Praneeth Netrapalli

This paper studies the problem of sparse regression where the goal is to learn a sparse vector that best optimizes a given objective function.

Generalization Bounds regression

Clustered Monotone Transforms for Rating Factorization

no code implementations31 Oct 2018 Gaurush Hiranandani, Raghav Somani, Oluwasanmi Koyejo, Sreangsu Acharyya

This non-linear transformation of the rating scale shatters the low-rank structure of the rating matrix, therefore resulting in a poor fit and consequentially, poor recommendations.

Recommendation Systems regression

A case study of Empirical Bayes in User-Movie Recommendation system

no code implementations7 Jul 2017 Arabin Kumar Dey, Raghav Somani, Sreangsu Acharyya

In this article we provide a formulation of empirical bayes described by Atchade (2011) to tune the hyperparameters of priors used in bayesian set up of collaborative filter.

Movie Recommendation

Cannot find the paper you are looking for? You can Submit a new open access paper.