StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Models

1 code implementation • 23 May 2022 • Adam Liška, Tomáš Kočiský, Elena Gribovskaya, Tayfun Terzi, Eren Sezener, Devang Agrawal, Cyprien de Masson d'Autume, Tim Scholtes, Manzil Zaheer, Susannah Young, Ellen Gilsenan-McMahon, Sophia Austin, Phil Blunsom, Angeliki Lazaridou

Knowledge and language understanding of models evaluated through question answering (QA) has been usually studied on static snapshots of knowledge, like Wikipedia.

Question Answering

Memorize or generalize? Searching for a compositional RNN in a haystack

1 code implementation • 18 Feb 2018 • Adam Liška, Germán Kruszewski, Marco Baroni

Neural networks are very powerful learning systems, but they do not readily generalize from one task to the other.