A Cheap Linear Attention Mechanism with Fast Lookups and Fixed-Size Representations

19 Sep 2016Alexandre de BrébissonPascal Vincent

The softmax content-based attention mechanism has proven to be very beneficial in many applications of recurrent neural networks. Nevertheless it suffers from two major computational limitations... (read more)

PDF Abstract


No code implementations yet. Submit your code now

Results from the Paper

  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods used in the Paper