Search Results for author:
Found 22 papers, 1 papers with code
Computing with Residue Numbers in High-Dimensional Representation
We introduce Residue Hyperdimensional Computing, a computing framework that unifies residue number systems with an algebra defined over random, high-dimensional vectors.
Efficient Decoding of Compositional Structure in Holistic Representations
In particular, we find that the decoding techniques from the sparse coding and compressed sensing literature (rarely used for Hyperdimensional Computing/Vector Symbolic Architectures) are also well-suited for decoding information from the compositional distributed representations.
Learning and generalization of compositional representations of visual scenes
In contrast to learning category labels, here we train deep neural networks to output the full compositional vector description of an input image.
Neuromorphic Visual Odometry with Resonator Networks
The VO network we propose generates and stores a working memory of the presented visual environment.
Neuromorphic Visual Scene Understanding with Resonator Networks
Understanding a visual scene by inferring identities and poses of its individual objects is still and open problem.
Deep Learning in Spiking Phasor Neural Networks
Spiking Neural Networks (SNNs) have attracted the attention of the deep learning community for use in low-latency, low-power neuromorphic hardware, as well as models for understanding neuroscience.
Integer Factorization with Compositional Distributed Representations
In this paper, we present an approach to integer factorization using distributed representations formed with Vector Symbolic Architectures.
Efficient Neuromorphic Signal Processing with Loihi 2
The biologically inspired spiking neurons used in neuromorphic computing are nonlinear filters with dynamic state variables -- very different from the stateless neuron models used in deep learning.
Computing on Functions Using Randomized Vector Representations
By analogy to VSA, we call this new function encoding and computing framework Vector Function Architecture (VFA).
Vector Symbolic Architectures as a Computing Framework for Emerging Hardware
We see them acting as a framework for computing with distributed representations that can play a role of an abstraction layer for emerging computing hardware.
Perceptron Theory Can Predict the Accuracy of Neural Networks
The perceptron theory compares favorably to other methods that do not rely on training an estimator model.
Cellular Automata Can Reduce Memory Requirements of Collective-State Computing
The variable encoding uses a fixed set of random patterns, which has to be stored and kept available during the computation.
Variable Binding for Sparse Distributed Representations: Theory and Applications
One binding method for general sparse vectors extends earlier proposals to reduce the tensor product into a vector, such as circular convolution.
Resonator networks for factoring distributed representations of data structures
The ability to encode and manipulate data structures with distributed neural representations could qualitatively enhance the capabilities of traditional neural networks by supporting rule-based symbolic reasoning, a central property of cognition.
Neuromorphic Nearest-Neighbor Search Using Intel's Pohoiki Springs
Neuromorphic computing applies insights from neuroscience to uncover innovations in computing technology.
Density Encoding Enables Resource-Efficient Randomly Connected Neural Networks
The deployment of machine learning algorithms on resource-constrained edge devices is an important challenge from both theoretical and applied points of view.
Resonator Networks outperform optimization methods at solving high-dimensional vector factorization
We develop theoretical foundations of Resonator Networks, a new type of recurrent neural network introduced in Frady et al. (2020) to solve a high-dimensional vector factorization problem arising in Vector Symbolic Architectures.
Robust computation with rhythmic spike patterns
Here, we propose a novel type of attractor neural network in complex state space, and show how it can be leveraged to construct spiking neural networks with robust computational properties through a phase-to-timing mapping.
A theory of sequence indexing and working memory in recurrent neural networks
The theory describes linear readout of analog data, and readout with winner-take-all error correction of symbolic data as proposed in VSA models.
Theory of the superposition principle for randomized connectionist representations in neural networks
The superposition operations in different existing models are mapped to linear neural networks with unitary recurrent matrices, in which retrieval accuracy can be analyzed by a single equation.
Integer Echo State Networks: Efficient Reservoir Computing for Digital Hardware
We propose an approximation of Echo State Networks (ESN) that can be efficiently implemented on digital hardware based on the mathematics of hyperdimensional computing.
Inferring and Learning from Neuronal Correspondences
We introduce and study methods for inferring and learning from correspondences among neurons.
