Bias-Variance Tradeoff in a Sliding Window Implementation of the Stochastic Gradient Algorithm

no code implementations • 25 Oct 2019 • Yakup Ceki Papo

We use the work of Fabian to characterize the mean and the variance of the distribution of the iterates in terms of the bias and the covariance matrix of the gradient estimators.