Following Instructions by Imagining and Reaching Visual Goals

no code implementations • 25 Jan 2020 • John Kanu, Eadom Dessalene, Xiaomin Lin, Cornelia Fermuller, Yiannis Aloimonos

While traditional methods for instruction-following typically assume prior linguistic and perceptual knowledge, many recent works in reinforcement learning (RL) have proposed learning policies end-to-end, typically by training neural networks to map joint representations of observations and instructions directly to actions.

Instruction Following Reinforcement Learning (RL)