Search Results for author: Fangyuan Xu

Found 7 papers, 4 papers with code

KIWI: A Dataset of Knowledge-Intensive Writing Instructions for Answering Research Questions

no code implementations6 Mar 2024 Fangyuan Xu, Kyle Lo, Luca Soldaini, Bailey Kuehl, Eunsol Choi, David Wadden

To evaluate the capabilities of current LLMs on this task, we construct KIWI, a dataset of knowledge-intensive writing instructions in the scientific domain.

Instruction Following

Understanding Retrieval Augmentation for Long-Form Question Answering

no code implementations18 Oct 2023 Hung-Ting Chen, Fangyuan Xu, Shane A. Arora, Eunsol Choi

Our study provides new insights on how retrieval augmentation impacts long, knowledge-rich text generation of LMs.

Long Form Question Answering Retrieval +1

RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentation

1 code implementation6 Oct 2023 Fangyuan Xu, Weijia Shi, Eunsol Choi

Retrieving documents and prepending them in-context at inference time improves performance of language model (LMs) on a wide range of tasks.

Language Modelling Open-Domain Question Answering +1

Concise Answers to Complex Questions: Summarization of Long-form Answers

1 code implementation30 May 2023 Abhilash Potluri, Fangyuan Xu, Eunsol Choi

Long-form question answering systems provide rich information by presenting paragraph-level answers, often containing optional background or auxiliary information.

Extractive Summarization Long Form Question Answering

A Critical Evaluation of Evaluations for Long-form Question Answering

1 code implementation29 May 2023 Fangyuan Xu, Yixiao Song, Mohit Iyyer, Eunsol Choi

We present a careful analysis of experts' evaluation, which focuses on new aspects such as the comprehensiveness of the answer.

Long Form Question Answering Text Generation

Modeling Exemplification in Long-form Question Answering via Retrieval

no code implementations NAACL 2022 Shufan Wang, Fangyuan Xu, Laure Thompson, Eunsol Choi, Mohit Iyyer

We show that not only do state-of-the-art LFQA models struggle to generate relevant examples, but also that standard evaluation metrics such as ROUGE are insufficient to judge exemplification quality.

Long Form Question Answering Retrieval

How Do We Answer Complex Questions: Discourse Structure of Long-form Answers

1 code implementation ACL 2022 Fangyuan Xu, Junyi Jessy Li, Eunsol Choi

Long-form answers, consisting of multiple sentences, can provide nuanced and comprehensive answers to a broader set of questions.

Natural Questions Sentence

Cannot find the paper you are looking for? You can Submit a new open access paper.