Search Results for author: Laurence Golding

Found 2 papers, 2 papers with code

The Pile: An 800GB Dataset of Diverse Text for Language Modeling

19 code implementations31 Dec 2020 Leo Gao, Stella Biderman, Sid Black, Laurence Golding, Travis Hoppe, Charles Foster, Jason Phang, Horace He, Anish Thite, Noa Nabeshima, Shawn Presser, Connor Leahy

Recent work has demonstrated that increased training dataset diversity improves general cross-domain knowledge and downstream generalization capability for large-scale language models.

Language Modelling

Cannot find the paper you are looking for? You can Submit a new open access paper.