Search Results for author:
Found 2 papers, 2 papers with code
What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?
In particular, we focus on text-to-text models and experiment with three model architectures (causal/non-causal decoder-only and encoder-decoder), trained with two different pretraining objectives (autoregressive and masked language modeling), and evaluated with and without multitask prompted finetuning.
Multitask Prompted Training Enables Zero-Shot Task Generalization
Large language models have recently been shown to attain reasonable zero-shot generalization on a diverse set of tasks (Brown et al., 2020).
Cannot find the paper you are looking for? You can
Submit a new open access paper.
