no code implementations • 19 Oct 2022 • Szilvia Ujváry, Zsigmond Telek, Anna Kerekes, Anna Mészáros, Ferenc Huszár
Sharpness-aware minimization (SAM) aims to improve the generalisation of gradient-based learning by seeking out flat minima.
no code implementations • 30 Oct 2023 • Szilvia Ujváry, Gergely Flamich, Vincent Fortuin, José Miguel Hernández Lobato
An important yet underexplored question in the PAC-Bayes literature is how much tightness we lose by restricting the posterior family to factorized Gaussian distributions when optimizing a PAC-Bayes bound.
no code implementations • 3 May 2024 • Patrik Reizinger, Szilvia Ujváry, Anna Mészáros, Anna Kerekes, Wieland Brendel, Ferenc Huszár
The last decade has seen blossoming research in deep learning theory attempting to answer, "Why does deep learning generalize?"