Search Results for author: Sid Black

Found 3 papers, 2 papers with code

Interpreting Neural Networks through the Polytope Lens

no code implementations22 Nov 2022 Sid Black, Lee Sharkey, Leo Grinsztajn, Eric Winsor, Dan Braun, Jacob Merizian, Kip Parker, Carlos Ramón Guevara, Beren Millidge, Gabriel Alfour, Connor Leahy

Previous mechanistic descriptions have used individual neurons or their linear combinations to understand the representations a network has learned.

The Pile: An 800GB Dataset of Diverse Text for Language Modeling

20 code implementations31 Dec 2020 Leo Gao, Stella Biderman, Sid Black, Laurence Golding, Travis Hoppe, Charles Foster, Jason Phang, Horace He, Anish Thite, Noa Nabeshima, Shawn Presser, Connor Leahy

Recent work has demonstrated that increased training dataset diversity improves general cross-domain knowledge and downstream generalization capability for large-scale language models.

Language Modelling

Cannot find the paper you are looking for? You can Submit a new open access paper.