Deep ReLU Networks Preserve Expected Length

no code implementations • ICLR 2022 • Boris Hanin, Ryan Jeong, David Rolnick

Assessing the complexity of functions computed by a neural network helps us understand how the network will learn and generalize.