no code implementations • 14 Dec 2022 • Kwangjun Ahn, Sébastien Bubeck, Sinho Chewi, Yin Tat Lee, Felipe Suarez, Yi Zhang
For these models, we provably establish the edge of stability phenomenon and discover a sharp phase transition for the step size below which the neural network fails to learn "threshold-like" neurons (i. e., neurons with a non-zero first-layer bias).
no code implementations • 1 Feb 2021 • Kwangjun Ahn, Felipe Suarez
We study the non-convex matrix factorization approach to matrix completion via Riemannian geometry.