no code implementations • 1 Jan 2021 • Stanislav Fort, Ekin Dogus Cubuk, Surya Ganguli, Samuel Stern Schoenholz
Deep neural network classifiers naturally partition input space into regions belonging to different classes.
no code implementations • 28 Sep 2020 • Neha S. Wadia, Daniel Duckworth, Samuel Stern Schoenholz, Ethan Dyer, Jascha Sohl-Dickstein
We show that both data whitening and second order optimization can harm or entirely prevent generalization.