Search Results for author: Maksim Nakhodnov

Found 2 papers, 2 papers with code

Training Scale-Invariant Neural Networks on the Sphere Can Happen in Three Regimes

1 code implementation8 Sep 2022 Maxim Kodryan, Ekaterina Lobacheva, Maksim Nakhodnov, Dmitry Vetrov

In this work, we investigate the properties of training scale-invariant neural networks directly on the sphere using a fixed ELR.

Cannot find the paper you are looking for? You can Submit a new open access paper.