# Riemannian approach to batch normalization

Minhyung ChoJaehyung Lee

Batch Normalization (BN) has proven to be an effective algorithm for deep neural network training by normalizing the input to each neuron and reducing the internal covariate shift. The space of weight vectors in the BN layer can be naturally interpreted as a Riemannian manifold, which is invariant to linear scaling of weights... (read more)

PDF Abstract