# Statistical inference using SGD

21 May 2017Tianyang LiLiu LiuAnastasios KyrillidisConstantine Caramanis

We present a novel method for frequentist statistical inference in $M$-estimation problems, based on stochastic gradient descent (SGD) with a fixed step size: we demonstrate that the average of such SGD sequences can be used for statistical inference, after proper scaling. An intuitive analysis using the Ornstein-Uhlenbeck process suggests that such averages are asymptotically normal... (read more)

PDF Abstract