Ziya2: Data-centric Learning is All LLMs Need

no code implementations • 6 Nov 2023 • Ruyi Gan, Ziwei Wu, Renliang Sun, Junyu Lu, XiaoJun Wu, Dixiang Zhang, Kunhao Pan, Junqing He, Yuanhe Tian, Ping Yang, Qi Yang, Hao Wang, Jiaxing Zhang, Yan Song

Although many such issues are addressed along the line of research on LLMs, an important yet practical limitation is that many studies overly pursue enlarging model sizes without comprehensively analyzing and optimizing the use of pre-training data in their learning process, as well as appropriate organization and leveraging of such data in training LLMs under cost-effective settings.

Orca: A Few-shot Benchmark for Chinese Conversational Machine Reading Comprehension

1 code implementation • 27 Feb 2023 • Nuo Chen, Hongguang Li, Junqing He, Yinan Bao, Xinshi Lin, Qi Yang, Jianfeng Liu, Ruyi Gan, Jiaxing Zhang, Baoyuan Wang, Jia Li

Thus, model's comprehension ability towards real scenarios are hard to evaluate reasonably.

Machine Reading Comprehension

Fengshenbang 1.0: Being the Foundation of Chinese Cognitive Intelligence

1 code implementation • 7 Sep 2022 • Jiaxing Zhang, Ruyi Gan, Junjie Wang, Yuxiang Zhang, Lin Zhang, Ping Yang, Xinyu Gao, Ziwei Wu, Xiaoqun Dong, Junqing He, Jianheng Zhuo, Qi Yang, Yongfeng Huang, Xiayu Li, Yanghan Wu, Junyu Lu, Xinyu Zhu, Weifeng Chen, Ting Han, Kunhao Pan, Rui Wang, Hao Wang, XiaoJun Wu, Zhongshen Zeng, Chongpei Chen

We hope that this project will be the foundation of Chinese cognitive intelligence.

Discriminating between Similar Languages on Imbalanced Conversational Texts

no code implementations • LREC 2018 • Junqing He, Xian Huang, Xuemin Zhao, Yan Zhang, Yonghong Yan

Language Identification

HCCL at SemEval-2017 Task 2: Combining Multilingual Word Embeddings and Transliteration Model for Semantic Similarity

no code implementations • SEMEVAL 2017 • Junqing He, Long Wu, Xuemin Zhao, Yonghong Yan

In this paper, we introduce an approach to combining word embeddings and machine translation for multilingual semantic word similarity, the task2 of SemEval-2017.

Cross-Lingual Word Embeddings Multilingual Word Embeddings +9