Reducing the number of neurons of Deep ReLU Networks based on the current theory of Regularization

no code implementations • 1 Jan 2021 • Jakob Heiss, Alexis Stockinger, Josef Teichmann

We introduce a new Reduction Algorithm which makes use of the properties of ReLU neurons to reduce significantly the number of neurons in a trained Deep Neural Network.