Aggregated Momentum: Stability Through Passive Damping

Momentum is a simple and widely used trick which allows gradient-based optimizers to pick up speed along low curvature directions. Its performance depends crucially on a damping coefficient $\beta$... (read more)

PDF Abstract ICLR 2019 PDF ICLR 2019 Abstract

Tasks


Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods used in the Paper


METHOD TYPE
AggMo
Stochastic Optimization