no code implementations • 1 Aug 2024 • Bozhou Li, Hao Liang, Zimo Meng, Wentao Zhang
Moreover, we analyzed the effects of LLM backbone parameter size and data quality on the pretraining outcomes.
Language Modelling Large Language Model