no code implementations • 4 Feb 2022 • Wei Huang, Chunrui Liu, Yilan Chen, Tianyu Liu, Richard Yi Da Xu
In addition to being a pure generalization bound analysis tool, PAC-Bayesian bound can also be incorporated into an objective function to train a probabilistic neural network, making them a powerful and relevant framework that can numerically provide a tight generalization bound for supervised learning.
no code implementations • 25 Nov 2020 • Wei Huang, Weitao Du, Richard Yi Da Xu, Chunrui Liu
We claim that depending on the separation conditions of data, the gradient descent iterates will converge to a flatter minimum in the catapult phase.