# Early Stopping is Nonparametric Variational Inference

6 Apr 2015Dougal MaclaurinDavid DuvenaudRyan P. Adams

We show that unconverged stochastic gradient descent can be interpreted as a procedure that samples from a nonparametric variational approximate posterior distribution. This distribution is implicitly defined as the transformation of an initial distribution by a sequence of optimization updates... (read more)

PDF Abstract