1 code implementation • 4 Dec 2017 • Gaétan Marceau-Caron, Yann Ollivier
The resulting natural Langevin dynamics combines the advantages of Amari's natural gradient descent and Fisher-preconditioned Langevin dynamics for large neural networks.
no code implementations • 25 Feb 2016 • Gaétan Marceau-Caron, Yann Ollivier
We provide the first experimental results on non-synthetic datasets for the quasi-diagonal Riemannian gradient descents for neural networks introduced in [Ollivier, 2015].
