Search Results for author: Kyle Aitken

Found 3 papers, 1 papers with code

Understanding How Encoder-Decoder Architectures Attend

no code implementations NeurIPS 2021 Kyle Aitken, Vinay V Ramasesh, Yuan Cao, Niru Maheswaranathan

Moreover, how these mechanisms vary depending on the particular architecture used for the encoder and decoder (recurrent, feed-forward, etc.)

The geometry of integration in text classification RNNs

1 code implementation ICLR 2021 Kyle Aitken, Vinay V. Ramasesh, Ankush Garg, Yuan Cao, David Sussillo, Niru Maheswaranathan

Using tools from dynamical systems analysis, we study recurrent networks trained on a battery of both natural and synthetic text classification tasks.

General Classification text-classification +1

On the asymptotics of wide networks with polynomial activations

no code implementations11 Jun 2020 Kyle Aitken, Guy Gur-Ari

We consider an existing conjecture addressing the asymptotic behavior of neural networks in the large width limit.

Cannot find the paper you are looking for? You can Submit a new open access paper.