# Diagonal Rescaling For Neural Networks

25 May 2017

We define a second-order neural network stochastic gradient training algorithm whose block-diagonal structure effectively amounts to normalizing the unit activations. Investigating why this algorithm lacks in robustness then reveals two interesting insights... (read more)

PDF Abstract