no code implementations • 6 Feb 2023 • Bryn Elesedy, Marcus Hutter
U-Clip is a simple amendment to gradient clipping that can be applied to any iterative gradient optimization algorithm.
no code implementations • NeurIPS 2021 • Bryn Elesedy
It is a commonly held belief that enforcing invariance improves generalisation.
no code implementations • 20 Feb 2021 • Bryn Elesedy, Sheheryar Zaidi
It is widely believed that engineering a model to be invariant/equivariant improves generalisation.
no code implementations • 16 Jul 2020 • Bryn Elesedy, Varun Kanade, Yee Whye Teh
We analyse the pruning procedure behind the lottery ticket hypothesis arXiv:1803. 03635v5, iterative magnitude pruning (IMP), when applied to linear models trained by gradient flow.