Search Results for author: Conor Houghton

Found 7 papers, 3 papers with code

Investigating grammatical abstraction in language models using few-shot learning of novel noun gender

no code implementations15 Mar 2024 Priyanka Sukumaran, Conor Houghton, Nina Kazanina

Language models were tasked with learning the gender of a novel noun embedding from a few examples in one grammatical agreement context and predicting agreement in another, unseen context.

Few-Shot Learning

Signatures of Bayesian inference emerge from energy efficient synapses

1 code implementation6 Sep 2023 James Malkin, Cian O'Donnell, Conor Houghton, Laurence Aitchison

The resulting networks revealed a tradeoff between circuit performance and the energetic cost of synaptic reliability.

Bayesian Inference Image Classification

Do LSTMs See Gender? Probing the Ability of LSTMs to Learn Abstract Syntactic Rules

1 code implementation31 Oct 2022 Priyanka Sukumaran, Conor Houghton, Nina Kazanina

However, we do not have a mechanistic understanding of how LSTMs perform such linguistic tasks.

Bayesian Modeling of Language-Evoked Event-Related Potentials

1 code implementation7 Jul 2022 Davide Turco, Conor Houghton

Bayesian hierarchical models are well-suited to analyzing the often noisy data from electroencephalography experiments in cognitive neuroscience: these models provide an intuitive framework to account for structures and correlations in the data, and they allow a straightforward handling of uncertainty.

Adaptive Estimators Show Information Compression in Deep Neural Networks

no code implementations ICLR 2019 Ivan Chelombiev, Conor Houghton, Cian O'Donnell

With two improved methods of estimation, firstly, we show that saturation of the activation function is not required for compression, and the amount of compression varies between different activation functions.

L2 Regularization Mutual Information Estimation

Cannot find the paper you are looking for? You can Submit a new open access paper.