no code implementations • ICLR 2022 • Greg Yang, Michael Santacroce, Edward J Hu
While a popular limit of infinite-width neural networks, the Neural Tangent Kernel (NTK) often exhibits performance gaps from finite-width neural networks on standard datasets, due to lack of feature learning.