Search Results for author:
Found 6 papers, 1 papers with code
Hidden Traveling Waves bind Working Memory Variables in Recurrent Neural Networks
Traveling waves are a fundamental phenomenon in the brain, playing a crucial role in short-term information storage.
Model Complexity of Program Phases
We anticipate that the knowledge of the behavior of this tradeoff may be beneficial in understanding the theoretical and practical limits of creation and deployment of models for resource constrained tasks.
Episodic Memory Theory for the Mechanistic Interpretation of Recurrent Neural Networks
Utilizing the EMT, we formulate a mathematically rigorous circuit that facilitates variable binding in these tasks.
Energy-based General Sequential Episodic Memory Networks at the Adiabatic Limit
We introduce a new class of General Sequential Episodic Memory Models (GSEMM) that, in the adiabatic limit, exhibit temporally changing energy surface, leading to a series of meta-stable states that are sequential episodic memories.
Learning proposals for sequential importance samplers using reinforced variational inference
The problem of inferring unobserved values in a partially observed trajectory from a stochastic process can be considered as a structured prediction problem.
A Study into the similarity in generator and discriminator in GAN architecture
One popular generative model that has high-quality results is the Generative Adversarial Networks(GAN).
