# Towards closing the gap between the theory and practice of SVRG

Othmane SebbouhNidham GazagnadouSamy JelassiFrancis BachRobert M. Gower

Among the very first variance reduced stochastic methods for solving the empirical risk minimization problem was the SVRG method (Johnson & Zhang 2013). SVRG is an inner-outer loop based method, where in the outer loop a reference full gradient is evaluated, after which $m \in \mathbb{N}$ steps of an inner loop are executed where the reference gradient is used to build a variance reduced estimate of the current gradient... (read more)

PDF Abstract

No code implementations yet. Submit your code now