Non Vanishing Gradients for Arbitrarily Deep Neural Networks: a Hamiltonian System Approach

no code implementations • NeurIPS Workshop DLDE 2021 • Clara Galimberti, Luca Furieri, Liang Xu, Giancarlo Ferrari-Trecate

Deep Neural Networks (DNNs) training can be difficult due to vanishing or exploding gradients during weight optimization through backpropagation.