MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning

no code implementations • 1 May 2022 • Ehud Karpas, Omri Abend, Yonatan Belinkov, Barak Lenz, Opher Lieber, Nir Ratner, Yoav Shoham, Hofit Bata, Yoav Levine, Kevin Leyton-Brown, Dor Muhlgay, Noam Rozen, Erez Schwartz, Gal Shachaf, Shai Shalev-Shwartz, Amnon Shashua, Moshe Tenenholtz

Huge language models (LMs) have ushered in a new era for AI, serving as a gateway to natural-language-based knowledge tasks.

Learning to Retrieve Passages without Supervision

1 code implementation • NAACL 2022 • Ori Ram, Gal Shachaf, Omer Levy, Jonathan Berant, Amir Globerson

Dense retrievers for open-domain question answering (ODQA) have been shown to achieve impressive performance by training on large datasets of question-passage pairs.

Contrastive Learning Open-Domain Question Answering +1

A Theoretical Analysis of Fine-tuning with Linear Teachers

no code implementations • NeurIPS 2021 • Gal Shachaf, Alon Brutzkus, Amir Globerson

We further present results on shallow ReLU models, and analyze the dependence of sample complexity there on source and target tasks.

Inductive Bias regression