Grounding Complex Navigational Instructions Using Scene Graphs

no code implementations • 3 Jun 2021 • Michiel de Jong, Satyapriya Krishna, Anuva Agarwal

Training a reinforcement learning agent to carry out natural language instructions is limited by the available supervision, i. e. knowing when the instruction has been carried out.

Question Answering reinforcement-learning +2

Interactive Image Generation Using Scene Graphs

no code implementations • ICLR Workshop DeepGenStruct 2019 • Gaurav Mittal, Shubham Agrawal, Anuva Agarwal, Sushant Mehta, Tanya Marwah

We propose a method to generate an image incrementally based on a sequence of graphs of scene descriptions (scene-graphs).

Image Generation Translation

ExCL: Extractive Clip Localization Using Natural Language Descriptions

1 code implementation • NAACL 2019 • Soham Ghosh, Anuva Agarwal, Zarana Parekh, Alexander Hauptmann

The task of retrieving clips within videos based on a given natural language query requires cross-modal reasoning over multiple frames.