Modeling Relationships in Referential Expressions with Compositional Modular Networks

CVPR 2017 Ronghang HuMarcus RohrbachJacob AndreasTrevor DarrellKate Saenko

People often refer to entities in an image in terms of their relationships with other entities. For example, "the black cat sitting under the table" refers to both a "black cat" entity and its relationship with another "table" entity... (read more)

PDF Abstract
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT LEADERBOARD
Visual Question Answering Visual7W CMN Percentage correct 72.53 # 1
Visual Question Answering Visual Genome (pairs) CMN Percentage correct 28.52 # 1
Visual Question Answering Visual Genome (subjects) CMN Percentage correct 44.24 # 1