De-randomized PAC-Bayes Margin Bounds: Applications to Non-convex and Non-smooth Predictors

23 Feb 2020Arindam BanerjeeTiancong ChenYingxue Zhou

In spite of several notable efforts, explaining the generalization of deterministic non-smooth deep nets, e.g., ReLU-nets, has remained challenging. Existing approaches for non-smooth deep nets typically need to bound the Lipschitz constant of such deep nets but such bounds are quite large, may even increase with the training set size yielding vacuous generalization bounds... (read more)

PDF Abstract

No code implementations yet. Submit your code now