no code implementations • EMNLP (NLLP) 2021 • Ozan Tonguz, Yiwei Qin, Yimeng Gu, Hyun Hannah Moon
Intellectual Property (IP) in the form of issued patents is a critical and very desirable element of innovation in high-tech.
1 code implementation • 7 Jan 2024 • Yiwei Qin, Kaiqiang Song, Yebowen Hu, Wenlin Yao, Sangwoo Cho, Xiaoyang Wang, Xuansheng Wu, Fei Liu, PengFei Liu, Dong Yu
This paper introduces the Decomposed Requirements Following Ratio (DRFR), a new metric for evaluating Large Language Models' (LLMs) ability to follow instructions.
no code implementations • 12 Dec 2022 • Yiwei Qin, Graham Neubig, PengFei Liu
Recently, a large number of tuning strategies have been proposed to adapt pre-trained language models to downstream tasks.
1 code implementation • 12 Dec 2022 • Yiwei Qin, Weizhe Yuan, Graham Neubig, PengFei Liu
Both have their advantages; discriminative metrics are able to directly optimize for the problem of distinguishing between good and bad outputs, while generative metrics can be trained using abundant raw text.