Benchmarks
| TREND | DATASET | BEST METHOD | PAPER TITLE | PAPER | CODE | COMPARE |
|---|---|---|---|---|---|---|
|
||||||
|
Greatest papers with code
UNITER: UNiversal Image-TExt Representation Learning
ECCV 2020
• ChenRocks/UNITER
• 
Different from previous work that applies joint random masking to both modalities, we use conditional masking on pre-training tasks (i. e., masked language/region modeling is conditioned on full observation of image/text).
Ranked #1 on
Visual Reasoning
on NLVR2 Test
LANGUAGE MODELLING QUESTION ANSWERING REFERRING EXPRESSION COMPREHENSION REPRESENTATION LEARNING TEXT MATCHING VISUAL COMMONSENSE REASONING VISUAL ENTAILMENT VISUAL QUESTION ANSWERING
Large-Scale Adversarial Training for Vision-and-Language Representation Learning
NeurIPS 2020
• zhegan27/VILLA
•
We present VILLA, the first known effort on large-scale adversarial training for vision-and-language (V+L) representation learning.
Ranked #2 on
Referring Expression Comprehension
on RefCoco
QUESTION ANSWERING REFERRING EXPRESSION COMPREHENSION REPRESENTATION LEARNING VISUAL COMMONSENSE REASONING VISUAL ENTAILMENT VISUAL QUESTION ANSWERING
Visual Entailment: A Novel Task for Fine-Grained Image Understanding
We evaluate various existing VQA baselines and build a model called Explainable Visual Entailment (EVE) system to address the VE task.
Ranked #1 on
Visual Entailment
on SNLI-VE val
NATURAL LANGUAGE INFERENCE QUESTION ANSWERING VISUAL ENTAILMENT VISUAL QUESTION ANSWERING VISUAL REASONING
Visual Entailment Task for Visually-Grounded Language Learning
We introduce a new inference task - Visual Entailment (VE) - which differs from traditional Textual Entailment (TE) tasks whereby a premise is defined by an image, rather than a natural language sentence as in TE tasks.
NATURAL LANGUAGE INFERENCE QUESTION ANSWERING VISUAL ENTAILMENT VISUAL QUESTION ANSWERING