Search Results for author:
Found 12 papers, 5 papers with code
BAP v2: An Enhanced Task Framework for Instruction Following in Minecraft Dialogues
It is a two-player game in which an Architect (A) instructs a Builder (B) to construct a target structure in a simulated Blocks World Environment.
Unsupervised Melody-to-Lyric Generation
Automatic melody-to-lyric generation is a task in which song lyrics are generated to go with a given melody.
Unsupervised Melody-Guided Lyrics Generation
At inference time, we leverage the crucial alignments between melody and lyrics and compile the given melody into constraints to guide the generation process.
Context-Situated Pun Generation
In this work, we propose a new task, context-situated pun generation, where a specific context represented by a set of keywords is provided, and the task is to first identify suitable pun words that are appropriate for the context, then generate puns based on the context keywords and the identified pun words.
ExPUNations: Augmenting Puns with Keywords and Explanations
The tasks of humor understanding and generation are challenging and subjective even for humans, requiring commonsense and real-world knowledge to master.
Human-guided Collaborative Problem Solving: A Natural Language based Framework
We consider the problem of human-machine collaborative problem solving as a planning task coupled with natural language communication.
TEACh: Task-driven Embodied Agents that Chat
Robots operating in human spaces must be able to engage in natural language interaction with people, both understanding and executing instructions, and using conversation to resolve ambiguity and recover from mistakes.
Style Control for Schema-Guided Natural Language Generation
Our results show that while high style accuracy and semantic correctness are easier to achieve for more lexically-defined styles with conditional training, stylistic control is also achievable for more semantically complex styles using discriminator-based guided decoding methods.
Learning to execute instructions in a Minecraft dialogue
The Minecraft Collaborative Building Task is a two-player game in which an Architect (A) instructs a Builder (B) to construct a target structure in a simulated Blocks World Environment.
Schema-Guided Natural Language Generation
We train different state-of-the-art models for neural natural language generation on this dataset and show that in many cases, including rich schema information allows our models to produce higher quality outputs both in terms of semantics and diversity.
Collaborative Dialogue in Minecraft
We wish to develop interactive agents that can communicate with humans to collaboratively solve tasks in grounded scenarios.
Towards Problem Solving Agents that Communicate and Learn
Agents that communicate back and forth with humans to help them execute non-linguistic tasks are a long sought goal of AI.
