Search Results for author: Bryn Elesedy

Found 4 papers, 0 papers with code

U-Clip: On-Average Unbiased Stochastic Gradient Clipping

no code implementations6 Feb 2023 Bryn Elesedy, Marcus Hutter

U-Clip is a simple amendment to gradient clipping that can be applied to any iterative gradient optimization algorithm.

LEMMA

Provably Strict Generalisation Benefit for Equivariant Models

no code implementations20 Feb 2021 Bryn Elesedy, Sheheryar Zaidi

It is widely believed that engineering a model to be invariant/equivariant improves generalisation.

Lottery Tickets in Linear Models: An Analysis of Iterative Magnitude Pruning

no code implementations16 Jul 2020 Bryn Elesedy, Varun Kanade, Yee Whye Teh

We analyse the pruning procedure behind the lottery ticket hypothesis arXiv:1803. 03635v5, iterative magnitude pruning (IMP), when applied to linear models trained by gradient flow.

Cannot find the paper you are looking for? You can Submit a new open access paper.