Hopular: Modern Hopfield Networks for Tabular Data

no code implementations • 29 Sep 2021 • Bernhard Schäfl, Lukas Gruber, Angela Bitto-Nemling, Sepp Hochreiter

In experiments on small-sized tabular datasets with less than 1, 000 samples, Hopular surpasses Gradient Boosting, Random Forests, SVMs, and in particular several Deep Learning methods.

Convergence Proof for Actor-Critic Methods Applied to PPO and RUDDER

no code implementations • 2 Dec 2020 • Markus Holzleitner, Lukas Gruber, José Arjona-Medina, Johannes Brandstetter, Sepp Hochreiter

We prove under commonly used assumptions the convergence of actor-critic reinforcement learning algorithms, which simultaneously learn a policy function, the actor, and a value function, the critic.

reinforcement-learning

Hopfield Networks is All You Need

2 code implementations • ICLR 2021 • Hubert Ramsauer, Bernhard Schäfl, Johannes Lehner, Philipp Seidl, Michael Widrich, Thomas Adler, Lukas Gruber, Markus Holzleitner, Milena Pavlović, Geir Kjetil Sandve, Victor Greiff, David Kreil, Michael Kopp, Günter Klambauer, Johannes Brandstetter, Sepp Hochreiter

The new update rule is equivalent to the attention mechanism used in transformers.

Immune Repertoire Classification Multiple Instance Learning

Modern Hopfield Networks and Attention for Immune Repertoire Classification

1 code implementation • NeurIPS 2020 • Michael Widrich, Bernhard Schäfl, Hubert Ramsauer, Milena Pavlović, Lukas Gruber, Markus Holzleitner, Johannes Brandstetter, Geir Kjetil Sandve, Victor Greiff, Sepp Hochreiter, Günter Klambauer

We show that the attention mechanism of transformer architectures is actually the update rule of modern Hopfield networks that can store exponentially many patterns.

Classification General Classification +3

The History of Mobile Augmented Reality

no code implementations • 6 May 2015 • Clemens Arth, Raphael Grasset, Lukas Gruber, Tobias Langlotz, Alessandro Mulloni, Daniel Wagner

This document summarizes the major milestones in mobile Augmented Reality between 1968 and 2014.

Human-Computer Interaction