1 code implementation • 15 Nov 2022 • Michael Murray, Hui Jin, Benjamin Bowman, Guido Montufar
We provide expressions for the coefficients of this power series which depend on both the Hermite coefficients of the activation function as well as the depth of the network.
no code implementations • ICLR 2022 • Hui Jin, Pradeep Kr. Banerjee, Guido Montúfar
We characterize the power-law asymptotics of learning curves for Gaussian process regression (GPR) under the assumption that the eigenspectrum of the prior and the eigenexpansion coefficients of the target function follow a power law.
1 code implementation • 12 Jun 2020 • Hui Jin, Guido Montúfar
\hj{For stochastic gradient descent we obtain the same implicit bias result.}