Search Results for author: Geyang Guo

Found 6 papers, 4 papers with code

CARE: Aligning Language Models for Regional Cultural Awareness

1 code implementation7 Apr 2025 Geyang Guo, Tarek Naous, Hiromi Wakaki, Yukiko Nishimura, Yuki Mitsufuji, Alan Ritter, Wei Xu

Existing language models (LMs) often exhibit a Western-centric bias and struggle to represent diverse cultural knowledge.

S$^{2}$FT: Efficient, Scalable and Generalizable LLM Fine-tuning by Structured Sparsity

no code implementations9 Dec 2024 Xinyu Yang, Jixuan Leng, Geyang Guo, Jiawei Zhao, Ryumei Nakada, Linjun Zhang, Huaxiu Yao, Beidi Chen

Utilizing this key insight, we propose a family of Structured Sparse Fine-Tuning (S$^{2}$FT) methods for LLMs, which concurrently achieve state-of-the-art fine-tuning performance, training efficiency, and inference scalability.

Arithmetic Reasoning

Preference Optimization for Reasoning with Pseudo Feedback

no code implementations25 Nov 2024 Fangkai Jiao, Geyang Guo, Xingxing Zhang, Nancy F. Chen, Shafiq Joty, Furu Wei

Specifically, using Mathstral-7B as our base model, we improve MATH results from 58. 3 to 68. 6, surpassing both NuminaMath-72B and GPT-4-Turbo-1106-preview.

GSM8K Math +1

LLMBox: A Comprehensive Library for Large Language Models

1 code implementation8 Jul 2024 Tianyi Tang, Yiwen Hu, Bingqian Li, Wenyang Luo, Zijing Qin, Haoxiang Sun, Jiapeng Wang, Shiyi Xu, Xiaoxue Cheng, Geyang Guo, Han Peng, Bowen Zheng, Yiru Tang, Yingqian Min, Yushuo Chen, Jie Chen, Yuanqian Zhao, Luran Ding, Yuhao Wang, Zican Dong, Chunxuan Xia, Junyi Li, Kun Zhou, Wayne Xin Zhao, Ji-Rong Wen

To facilitate the research on large language models (LLMs), this paper presents a comprehensive and unified library, LLMBox, to ease the development, use, and evaluation of LLMs.

Towards Effective Ancient Chinese Translation: Dataset, Model, and Evaluation

1 code implementation1 Aug 2023 Geyang Guo, Jiarong Yang, Fengyuan LU, Jiaxin Qin, Tianyi Tang, Wayne Xin Zhao

From an evaluation perspective, we build a benchmark to judge ancient Chinese translation quality in different scenarios and evaluate the ancient Chinese translation capacities of various existing models.

Language Modeling Language Modelling +1

Cannot find the paper you are looking for? You can Submit a new open access paper.