Search Results for author:
Found 4 papers, 0 papers with code
Human or Not? A Gamified Approach to the Turing Test
Over the course of a month, the game was played by over 1. 5 million users who engaged in anonymous two-minute chat sessions with either another human or an AI language model which was prompted to behave like humans.
Standing on the Shoulders of Giant Frozen Language Models
To demonstrate this, we introduce three novel methods for leveraging frozen models: input-dependent prompt tuning, frozen readers, and recursive LMs, each of which vastly improves on current frozen-model approaches.
The Inductive Bias of In-Context Learning: Rethinking Pretraining Example Design
We highlight a bias introduced by this common practice: we prove that the pretrained NLM can model much stronger dependencies between text segments that appeared in the same training example, than it can between text segments that appeared in different training examples.
Which transformer architecture fits my data? A vocabulary bottleneck in self-attention
After their successful debut in natural language processing, Transformer architectures are now becoming the de-facto standard in many domains.
