no code implementations • 2 Dec 2024 • Xian Shuai, Yiding Wang, Yimeng Wu, Xin Jiang, Xiaozhe Ren
In this paper, we empirically investigate how a critical hyper-parameter, i. e., the global batch size, influences the LLM training prdocess.
1 code implementation • 9 Nov 2023 • Fanxu Meng, Haotong Yang, Yiding Wang, Muhan Zhang
The human brain is naturally equipped to comprehend and interpret visual information rapidly.
2 code implementations • 19 Sep 2023 • Aiyuan Yang, Bin Xiao, Bingning Wang, Borong Zhang, Ce Bian, Chao Yin, Chenxu Lv, Da Pan, Dian Wang, Dong Yan, Fan Yang, Fei Deng, Feng Wang, Feng Liu, Guangwei Ai, Guosheng Dong, Haizhou Zhao, Hang Xu, Haoze Sun, Hongda Zhang, Hui Liu, Jiaming Ji, Jian Xie, Juntao Dai, Kun Fang, Lei Su, Liang Song, Lifeng Liu, Liyun Ru, Luyao Ma, Mang Wang, Mickel Liu, MingAn Lin, Nuolan Nie, Peidong Guo, Ruiyang Sun, Tao Zhang, Tianpeng Li, Tianyu Li, Wei Cheng, WeiPeng Chen, Xiangrong Zeng, Xiaochuan Wang, Xiaoxi Chen, Xin Men, Xin Yu, Xuehai Pan, Yanjun Shen, Yiding Wang, Yiyu Li, Youxin Jiang, Yuchen Gao, Yupeng Zhang, Zenan Zhou, Zhiying Wu
Large language models (LLMs) have demonstrated remarkable performance on a variety of natural language tasks based on just a few examples of natural language instructions, reducing the need for extensive feature engineering.
no code implementations • 14 Jul 2023 • Linkai Luo, Qiaoling Yang, Hong Peng, Yiding Wang, Ziyang Chen
We first formulate the training and parameter selection of SVC as a minimax optimization problem named as MaxMin-L2-SVC-NCH, in which the minimization problem is an optimization problem of finding the closest points between two normal convex hulls (L2-SVC-NCH) while the maximization problem is an optimization problem of finding the optimal Gaussian kernel parameters.
no code implementations • 17 Jan 2022 • Yiding Wang, Decang Sun, Kai Chen, Fan Lai, Mosharaf Chowdhury
To explore this, we first introduce the notion of training plasticity to quantify the training progress of internal DNN layers.
no code implementations • 26 Aug 2020 • Yiding Wang, Zhenyi Wang, Chenghao Li, Yilin Zhang, Haizhou Wang
In recent years, due to the mental burden of depression, the number of people who endanger their lives has been increasing rapidly.