no code implementations • ICML 2020 • Chaitanya K. Ryali, John J. Hopfield, Leopold Grinberg, Dmitry Krotov
Building on inspiration from FlyHash and the ubiquity of sparse expansive representations in neurobiology, our work proposes a novel hashing algorithm BioHash that produces sparse high dimensional hash codes in a data-driven manner.
no code implementations • 4 Jan 2017 • Dmitry Krotov, John J. Hopfield
Third, adversarial images constructed by models with small power of the interaction vertex, which are equivalent to DNN with rectified linear units (ReLU), fail to transfer to and fool the models with higher order interactions.
3 code implementations • NeurIPS 2016 • Dmitry Krotov, John J. Hopfield
The proposed duality makes it possible to apply energy-based intuition from associative memory to analyze computational properties of neural networks with unusual activation functions - the higher rectified polynomials which until now have not been used in deep learning.