no code implementations • 14 Sep 2016 • Sébastien Gadat, Fabien Panloup, Sofiane Saadane
This paper deals with a natural stochastic optimization procedure derived from the so-called Heavy-ball method differential equation, which was introduced by Polyak in the 1960s with his seminal contribution [Pol64].
no code implementations • 17 Feb 2015 • Sébastien Gadat, Fabien Panloup, Sofiane Saadane
Narendra-Shapiro (NS) algorithms are bandit-type algorithms that have been introduced in the sixties (with a view to applications in Psychology or learning automata), whose convergence has been intensively studied in the stochastic algorithm literature.