Search Results for author:
Found 6 papers, 5 papers with code
ScienceWorld: Is your Agent Smarter than a 5th Grader?
We present ScienceWorld, a benchmark to test agents' scientific reasoning abilities in a new interactive text environment at the level of a standard elementary school science curriculum.
Behavior Cloned Transformers are Neurosymbolic Reasoners
In this work, we explore techniques for augmenting interactive agents with information from symbolic modules, much like humans use tools like calculators and GPS systems to assist with arithmetic and navigation.
ByteSized32: A Corpus and Challenge Task for Generating Task-Specific World Models Expressed as Text Games
In this work, we investigate the capacity of language models to generate explicit, interpretable, and interactive world models of scientific and common-sense reasoning tasks.
LifeQA: A Real-life Dataset for Video Question Answering
We introduce LifeQA, a benchmark dataset for video question answering that focuses on day-to-day real-life situations.
FIBER: Fill-in-the-Blanks as a Challenging Video Understanding Evaluation Framework
We propose fill-in-the-blanks as a video understanding evaluation framework and introduce FIBER -- a novel dataset consisting of 28, 000 videos and descriptions in support of this evaluation framework.
Self-Supervised Behavior Cloned Transformers are Path Crawlers for Text Games
In this work, we introduce a self-supervised behavior cloning transformer for text games, which are challenging benchmarks for multi-step reasoning in virtual environments.
