1 code implementation • 26 Feb 2024 • Yiding Sun, Feng Wang, Yutao Zhu, Wayne Xin Zhao, Jiaxin Mao
The ability of the foundation models heavily relies on large-scale, diverse, and high-quality pretraining data.