# Taylorized Training: Towards Better Approximation of Neural Network Training at Finite Width

10 Feb 2020Yu BaiBen KrauseHuan WangCaiming XiongRichard Socher

We propose \emph{Taylorized training} as an initiative towards better understanding neural network training at finite width. Taylorized training involves training the $k$-th order Taylor expansion of the neural network at initialization, and is a principled extension of linearized training---a recently proposed theory for understanding the success of deep learning... (read more)

PDF Abstract

No code implementations yet. Submit your code now