Search Results for author: Christian Goodbrake

Found 2 papers, 0 papers with code

Unnatural Algorithms in Machine Learning

no code implementations7 Dec 2023 Christian Goodbrake

Natural gradient descent has a remarkable property that in the small learning rate limit, it displays an invariance with respect to network reparameterizations, leading to robust training behavior even for highly covariant network parameterizations.

Cannot find the paper you are looking for? You can Submit a new open access paper.