Comparing Spectral Bias and Robustness For Two-Layer Neural Networks: SGD vs Adaptive Random Fourier Features

no code implementations • 1 Feb 2024 • Aku Kammonen, Lisi Liang, Anamika Pandey, Raúl Tempone

We present experimental results highlighting two key differences resulting from the choice of training algorithm for two-layer neural networks.