Beyond Backprop: Online Alternating Minimization with Auxiliary Variables

24 Jun 2018Anna ChoromanskaBenjamin CowenSadhana KumaravelRonny LussMattia RigottiIrina RishBrian KingsburyPaolo DiAchilleViatcheslav GurevRavi TejwaniDjallel Bouneffouf

Despite significant recent advances in deep neural networks, training them remains a challenge due to the highly non-convex nature of the objective function. State-of-the-art methods rely on error backpropagation, which suffers from several well-known issues, such as vanishing and exploding gradients, inability to handle non-differentiable nonlinearities and to parallelize weight-updates across layers, and biological implausibility... (read more)

PDF Abstract


No code implementations yet. Submit your code now


Results from the Paper

  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.