Nonlinear Conjugate Gradients For Scaling Synchronous Distributed DNN Training

1 code implementation • 7 Dec 2018 • Saurabh Adya, Vinay Palakkode, Oncel Tuzel

In this work, we propose and evaluate the stochastic preconditioned nonlinear conjugate gradient algorithm for large scale DNN training tasks.

16k General Classification