On the Impact of Overparameterization on the Training of a Shallow Neural Network in High Dimensions

no code implementations • 7 Nov 2023 • Simon Martin, Francis Bach, Giulio Biroli

We study the training dynamics of a shallow neural network with quadratic activation functions and quadratic cost in a teacher-student setup.