Chinese SafetyQA: A Safety Short-form Factuality Benchmark for Large Language Models

no code implementations • 17 Dec 2024 • Yingshui Tan, Boren Zheng, Baihui Zheng, Kerui Cao, Huiyun Jing, Jincheng Wei, Jiaheng Liu, Yancheng He, Wenbo Su, Xiangyong Zhu, Bo Zheng, Kaifu Zhang

With the rapid advancement of Large Language Models (LLMs), significant safety concerns have emerged.

Ethics RAG

Chinese SimpleQA: A Chinese Factuality Evaluation for Large Language Models

no code implementations • 11 Nov 2024 • Yancheng He, Shilong Li, Jiaheng Liu, Yingshui Tan, Weixun Wang, Hui Huang, Xingyuan Bu, Hangyu Guo, Chengwei Hu, Boren Zheng, Zhuoran Lin, Xuepeng Liu, Dekai Sun, Shirong Lin, Zhicheng Zheng, Xiaoyong Zhu, Wenbo Su, Bo Zheng

Based on Chinese SimpleQA, we perform a comprehensive evaluation on the factuality abilities of existing LLMs.

PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference

no code implementations • 20 Jun 2024 • Jiaming Ji, Donghai Hong, Borong Zhang, Boyuan Chen, Josef Dai, Boren Zheng, Tianyi Qiu, Boxun Li, Yaodong Yang

In this work, we introduce the PKU-SafeRLHF dataset, designed to promote research on safety alignment in large language models (LLMs).

Question Answering Safety Alignment