no code implementations • 30 Oct 2023 • Szilvia Ujváry, Gergely Flamich, Vincent Fortuin, José Miguel Hernández Lobato
An important yet underexplored question in the PAC-Bayes literature is how much tightness we lose by restricting the posterior family to factorized Gaussian distributions when optimizing a PAC-Bayes bound.
no code implementations • 19 Oct 2022 • Szilvia Ujváry, Zsigmond Telek, Anna Kerekes, Anna Mészáros, Ferenc Huszár
Sharpness-aware minimization (SAM) aims to improve the generalisation of gradient-based learning by seeking out flat minima.