Search Results for author: Pierre Youssef

Found 1 papers, 0 papers with code

How Bad is Training on Synthetic Data? A Statistical Analysis of Language Model Collapse

no code implementations7 Apr 2024 Mohamed El Amine Seddik, Suei-Wen Chen, Soufiane Hayou, Pierre Youssef, Merouane Debbah

With the aim of rigorously understanding model collapse in language models, we consider in this paper a statistical model that allows us to characterize the impact of various recursive training scenarios.

Language Modelling

Cannot find the paper you are looking for? You can Submit a new open access paper.