Search Results for author: Szilvia Ujváry

Found 3 papers, 0 papers with code

Rethinking Sharpness-Aware Minimization as Variational Inference

no code implementations19 Oct 2022 Szilvia Ujváry, Zsigmond Telek, Anna Kerekes, Anna Mészáros, Ferenc Huszár

Sharpness-aware minimization (SAM) aims to improve the generalisation of gradient-based learning by seeking out flat minima.

Variational Inference

Estimating optimal PAC-Bayes bounds with Hamiltonian Monte Carlo

no code implementations30 Oct 2023 Szilvia Ujváry, Gergely Flamich, Vincent Fortuin, José Miguel Hernández Lobato

An important yet underexplored question in the PAC-Bayes literature is how much tightness we lose by restricting the posterior family to factorized Gaussian distributions when optimizing a PAC-Bayes bound.

Understanding LLMs Requires More Than Statistical Generalization

no code implementations3 May 2024 Patrik Reizinger, Szilvia Ujváry, Anna Mészáros, Anna Kerekes, Wieland Brendel, Ferenc Huszár

The last decade has seen blossoming research in deep learning theory attempting to answer, "Why does deep learning generalize?"

In-Context Learning Learning Theory

Cannot find the paper you are looking for? You can Submit a new open access paper.