Geometry and Generalization: Eigenvalues as predictors of where a network will fail to generalize

no code implementations • 13 Jul 2021 • Susama Agarwala, Benjamin Dees, Andrew Gearhart, Corey Lowman

We study the deformation of the input space by a trained autoencoder via the Jacobians of the trained weight matrices.