no code implementations • SIGDIAL (ACL) 2022 • Carlos Gemmell, Federico Rossetto, Iain Mackie, Paul Owoicho, Sophie Fischer, Jeff Dalton
We present GRILLBot, an open-source multi-modal task-oriented voice assistant to help users perform complex tasks, focusing on the domains of cooking and home improvement.
1 code implementation • 1 Mar 2024 • Sophie Fischer, Federico Rossetto, Carlos Gemmell, Andrew Ramsay, Iain Mackie, Philip Zubel, Niklas Tecklenburg, Jeffrey Dalton
We present the second version of the Open Assistant Toolkit (OAT-v2), an open-source task-oriented conversational system for composing generative neural models.
1 code implementation • 12 Feb 2024 • Sophie Fischer, Carlos Gemmell, Niklas Tecklenburg, Iain Mackie, Federico Rossetto, Jeffrey Dalton
We tackle the challenge of building real-world multimodal assistants for complex real-world tasks.
no code implementations • 31 Aug 2022 • Carlos Gemmell, Iain Mackie, Paul Owoicho, Federico Rossetto, Sophie Fischer, Jeffrey Dalton
GRILLBot is the winning system in the 2022 Alexa Prize TaskBot Challenge, moving towards the next generation of multimodal task assistants.
2 code implementations • 23 Aug 2022 • Sophie Fischer, Carlos Gemmell, Iain Mackie, Jeffrey Dalton
This work addresses challenges in developing conversational assistants that support rich multimodal video interactions to accomplish real-world tasks interactively.
2 code implementations • 9 May 2022 • Iain Mackie, Paul Owoicho, Carlos Gemmell, Sophie Fischer, Sean MacAvaney, Jeffrey Dalton
We also show that the manual query reformulations significantly improve document ranking and entity ranking performance.