CoDraw: Collaborative Drawing as a Testbed for Grounded Goal-driven Communication

ICLR 2019 Jin-Hwa Kim • Nikita Kitaev • Xinlei Chen • Marcus Rohrbach • Yuandong Tian • Dhruv Batra • Devi Parikh

Our game is grounded in a virtual world that contains movable clip art objects. The game involves two players: a Teller and a Drawer. We define protocols and metrics to evaluate the effectiveness of learned agents on this testbed, highlighting the need for a novel crosstalk condition which pairs agents trained independently on disjoint subsets of the training data for evaluation.

Full paper

Evaluation


No evaluation results yet. Help compare this paper to other papers by submitting the tasks and evaluation metrics from the paper.