Sparse and Continuous Attention Mechanisms

12 Jun 2020André F. T. MartinsMarcos TrevisoAntónio FarinhasVlad NiculaeMário A. T. FigueiredoPedro M. Q. Aguiar

Exponential families are widely used in machine learning; they include many distributions in continuous and discrete domains (e.g., Gaussian, Dirichlet, Poisson, and categorical distributions via the softmax transformation). Distributions in each of these families have fixed support... (read more)

PDF Abstract
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT LEADERBOARD
Visual Question Answering VQA v2 test-dev 2D continuous softmax Accuracy 65.96 # 16
Visual Question Answering VQA v2 test-std 2D continuous softmax Accuracy 66.27 # 15

Methods used in the Paper