Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task

1 code implementation • 24 Oct 2022 • Kenneth Li, Aspen K. Hopkins, David Bau, Fernanda Viégas, Hanspeter Pfister, Martin Wattenberg

Language models show a surprising range of capabilities, but the source of their apparent competence is unclear.