Search Results for author:
Found 4 papers, 2 papers with code
Estimating the Local Learning Coefficient at Scale
The \textit{local learning coefficient} (LLC) is a principled way of quantifying model complexity, originally derived in the context of Bayesian statistics using singular learning theory (SLT).
Dynamical versus Bayesian Phase Transitions in a Toy Model of Superposition
We investigate phase transitions in a Toy Model of Superposition (TMS) using Singular Learning Theory (SLT).
Quantifying degeneracy in singular models via the learning coefficient
Deep neural networks (DNN) are singular statistical models which exhibit complex degeneracies.
Variational Bayesian Neural Networks via Resolution of Singularities
In this work, we advocate for the importance of singular learning theory (SLT) as it pertains to the theory and practice of variational inference in Bayesian neural networks (BNNs).
Cannot find the paper you are looking for? You can
Submit a new open access paper.
