Search Results for author: Matthew S. Zhang

Found 3 papers, 0 papers with code

Sampling from the Mean-Field Stationary Distribution

no code implementations12 Feb 2024 Yunbum Kook, Matthew S. Zhang, Sinho Chewi, Murat A. Erdogdu, Mufan Bill Li

We study the complexity of sampling from the stationary distribution of a mean-field SDE, or equivalently, the complexity of minimizing a functional over the space of probability measures which includes an interaction term.

Convergence and Optimality of Policy Gradient Methods in Weakly Smooth Settings

no code implementations30 Oct 2021 Matthew S. Zhang, Murat A. Erdogdu, Animesh Garg

Policy gradient methods have been frequently applied to problems in control and reinforcement learning with great success, yet existing convergence analysis still relies on non-intuitive, impractical and often opaque conditions.

Policy Gradient Methods reinforcement-learning +1

Convergence of Langevin Monte Carlo in Chi-Squared and Renyi Divergence

no code implementations22 Jul 2020 Murat A. Erdogdu, Rasa Hosseinzadeh, Matthew S. Zhang

We prove that, initialized with a Gaussian random vector that has sufficiently small variance, iterating the LMC algorithm for $\widetilde{\mathcal{O}}(\lambda^2 d\epsilon^{-1})$ steps is sufficient to reach $\epsilon$-neighborhood of the target in both Chi-squared and Renyi divergence, where $\lambda$ is the logarithmic Sobolev constant of $\nu_*$.

Cannot find the paper you are looking for? You can Submit a new open access paper.