1 code implementation • 18 Sep 2024 • Ekaterina Grishina, Mikhail Gorbunov, Maxim Rakhuba
Controlling the spectral norm of the Jacobian matrix, which is related to the convolution operation, has been shown to improve generalization, training stability and robustness in CNNs.
no code implementations • 14 Jun 2024 • Mikhail Gorbunov, Nikolay Yudin, Vera Soboleva, Aibek Alanov, Alexey Naumov, Maxim Rakhuba
The increasing size of neural networks has led to a growing demand for methods of efficient fine-tuning.