Neural Taylor Approximations: Convergence and Exploration in Rectifier Networks

no code implementations • ICML 2017 • David Balduzzi, Brian McWilliams, Tony Butler-Yeoman

Modern convolutional networks, incorporating rectifiers and max-pooling, are neither smooth nor convex; standard guarantees therefore do not apply.