Stochastic algorithms with geometric step decay converge linearly on sharp functions

22 Jul 2019Damek DavisDmitriy DrusvyatskiyVasileios Charisopoulos

Stochastic (sub)gradient methods require step size schedule tuning to perform well in practice. Classical tuning strategies decay the step size polynomially and lead to optimal sublinear rates on (strongly) convex problems... (read more)

PDF Abstract


No code implementations yet. Submit your code now


Results from the Paper

  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods used in the Paper