The duality structure gradient descent algorithm: analysis and applications to neural networks

1 Aug 2017 Thomas Flynn

The training of deep neural networks is typically carried out using some form of gradient descent, often with great success. However, existing non-asymptotic analyses of first-order optimization algorithms typically employ a gradient smoothness assumption that is too strong to be applicable in the case of deep neural networks... (read more)

PDF Abstract
No code implementations yet. Submit your code now

Tasks


Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods used in the Paper


METHOD TYPE
🤖 No Methods Found Help the community by adding them if they're not listed; e.g. Deep Residual Learning for Image Recognition uses ResNet