Guanghui WangShiyin LuWeiwei TuLijun Zhang

The Adam algorithm has become extremely popular for large-scale machine learning. Under convexity condition, it has been proved to enjoy a data-dependant $O(\sqrt{T})$ regret bound where $T$ is the time horizon... (read more)

PDF Abstract