Search Results for author: Matthew Farrugia-Roberts

Found 3 papers, 0 papers with code

The Developmental Landscape of In-Context Learning

no code implementations4 Feb 2024 Jesse Hoogland, George Wang, Matthew Farrugia-Roberts, Liam Carroll, Susan Wei, Daniel Murfet

We show that in-context learning emerges in transformers in discrete developmental stages, when they are trained on either language modeling or linear regression tasks.

In-Context Learning Language Modelling +1

Computational Complexity of Detecting Proximity to Losslessly Compressible Neural Network Parameters

no code implementations5 Jun 2023 Matthew Farrugia-Roberts

To better understand complexity in neural networks, we theoretically investigate the idealised phenomenon of lossless network compressibility, whereby an identical function can be implemented with a smaller network.

Cannot find the paper you are looking for? You can Submit a new open access paper.