1 code implementation • 4 Apr 2021 • Tasmia Tasrin, Md Sultan Al Nahian, Habarakadage Perera, Brent Harrison
In this work, we explore how natural language advice can be used to provide a richer feedback signal to a reinforcement learning agent by extending policy shaping, a well-known Interactive reinforcement learning technique.
no code implementations • 23 Apr 2020 • Tasmia Tasrin, Md Sultan Al Nahian, Brent Harrison
In this work, we propose a deep neural architecture that uses an attention mechanism which utilizes region based image features, the natural language question asked, and semantic knowledge extracted from the regions of an image to produce open-ended answers for questions asked in a visual question answering (VQA) task.
no code implementations • 26 Sep 2019 • Md Sultan Al Nahian, Tasmia Tasrin, Sagar Gandhi, Ryan Gaines, Brent Harrison
One of the primary challenges of visual storytelling is developing techniques that can maintain the context of the story over long event sequences to generate human-like stories.