# Uniform convergence may be unable to explain generalization in deep learning

Vaishnavh NagarajanJ. Zico Kolter

Aimed at explaining the surprisingly good generalization behavior of overparameterized deep networks, recent works have developed a variety of generalization bounds for deep learning, all based on the fundamental learning-theoretic technique of uniform convergence. While it is well-known that many of these existing bounds are numerically large, through numerous experiments, we bring to light a more concerning aspect of these bounds: in practice, these bounds can {\em increase} with the training dataset size... (read more)

PDF Abstract NeurIPS 2019 PDF NeurIPS 2019 Abstract