Search Results for author: Max Milkert

Found 1 papers, 0 papers with code

Compelling ReLU Network Initialization and Training to Leverage Exponential Scaling with Depth

no code implementations29 Nov 2023 Max Milkert, David Hyde, Forrest Laine

To address this issue, we introduce a novel training strategy: we first reparameterize the network weights in a manner that forces an exponential number of activation patterns to manifest.

Cannot find the paper you are looking for? You can Submit a new open access paper.