Search Results for author:
Found 9 papers, 5 papers with code
GRILLBot: A multi-modal conversational agent for complex real-world tasks
We present GRILLBot, an open-source multi-modal task-oriented voice assistant to help users perform complex tasks, focusing on the domains of cooking and home improvement.
Open Assistant Toolkit -- version 2
We present the second version of the Open Assistant Toolkit (OAT-v2), an open-source task-oriented conversational system for composing generative neural models.
GRILLBot In Practice: Lessons and Tradeoffs Deploying Large Language Models for Adaptable Conversational Task Assistants
We tackle the challenge of building real-world multimodal assistants for complex real-world tasks.
Generate, Transform, Answer: Question Specific Tool Synthesis for Tabular Data
Tabular question answering (TQA) presents a challenging setting for neural systems by requiring joint reasoning of natural language with large amounts of semi-structured data.
GRILLBot: An Assistant for Real-World Tasks with Neural Semantic Parsing and Graph-Based Representations
GRILLBot is the winning system in the 2022 Alexa Prize TaskBot Challenge, moving towards the next generation of multimodal task assistants.
Induced Natural Language Rationales and Interleaved Markup Tokens Enable Extrapolation in Large Language Models
Our experimental results show that generating step-by-step rationales and introducing marker tokens are both required for effective extrapolation.
VILT: Video Instructions Linking for Complex Tasks
This work addresses challenges in developing conversational assistants that support rich multimodal video interactions to accomplish real-world tasks interactively.
CODEC: Complex Document and Entity Collection
We also show that the manual query reformulations significantly improve document ranking and entity ranking performance.
Relevance Transformer: Generating Concise Code Snippets with Relevance Feedback
Tools capable of automatic code generation have the potential to augment programmer's capabilities.
