no code implementations • SIGDIAL (ACL) 2022 • Carlos Gemmell, Federico Rossetto, Iain Mackie, Paul Owoicho, Sophie Fischer, Jeff Dalton
We present GRILLBot, an open-source multi-modal task-oriented voice assistant to help users perform complex tasks, focusing on the domains of cooking and home improvement.
1 code implementation • 1 Mar 2024 • Sophie Fischer, Federico Rossetto, Carlos Gemmell, Andrew Ramsay, Iain Mackie, Philip Zubel, Niklas Tecklenburg, Jeffrey Dalton
We present the second version of the Open Assistant Toolkit (OAT-v2), an open-source task-oriented conversational system for composing generative neural models.
1 code implementation • 12 Feb 2024 • Sophie Fischer, Carlos Gemmell, Niklas Tecklenburg, Iain Mackie, Federico Rossetto, Jeffrey Dalton
We tackle the challenge of building real-world multimodal assistants for complex real-world tasks.
no code implementations • 17 Mar 2023 • Carlos Gemmell, Jeffrey Dalton
Tabular question answering (TQA) presents a challenging setting for neural systems by requiring joint reasoning of natural language with large amounts of semi-structured data.
no code implementations • 31 Aug 2022 • Carlos Gemmell, Iain Mackie, Paul Owoicho, Federico Rossetto, Sophie Fischer, Jeffrey Dalton
GRILLBot is the winning system in the 2022 Alexa Prize TaskBot Challenge, moving towards the next generation of multimodal task assistants.
1 code implementation • 24 Aug 2022 • Mirelle Bueno, Carlos Gemmell, Jeffrey Dalton, Roberto Lotufo, Rodrigo Nogueira
Our experimental results show that generating step-by-step rationales and introducing marker tokens are both required for effective extrapolation.
2 code implementations • 23 Aug 2022 • Sophie Fischer, Carlos Gemmell, Iain Mackie, Jeffrey Dalton
This work addresses challenges in developing conversational assistants that support rich multimodal video interactions to accomplish real-world tasks interactively.
2 code implementations • 9 May 2022 • Iain Mackie, Paul Owoicho, Carlos Gemmell, Sophie Fischer, Sean MacAvaney, Jeffrey Dalton
We also show that the manual query reformulations significantly improve document ranking and entity ranking performance.
no code implementations • 6 Jul 2020 • Carlos Gemmell, Federico Rossetto, Jeffrey Dalton
Tools capable of automatic code generation have the potential to augment programmer's capabilities.