Towards Model-Size Agnostic, Compute-Free, Memorization-based Inference of Deep Learning

no code implementations • 14 Jul 2023 • Davide Giacomini, Maeesha Binte Hashem, Jeremiah Suarez, Swarup Bhunia, Amit Ranjan Trivedi

Specifically, our work capitalizes on the inference mechanism of the recurrent attention model (RAM), where only a small window of input domain (glimpse) is processed in a one time step, and the outputs from multiple glimpses are combined through a hidden vector to determine the overall classification output of the problem.

Bayesian Optimization Memorization +2