Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Model

Automatic generation of summaries from multiple news articles is a valuable tool as the number of online publications grows rapidly. Single document summarization (SDS) systems have benefited from advances in neural encoder-decoder model thanks to the availability of large datasets. However, multi-document summarization (MDS) of news articles has been limited to datasets of a couple of hundred examples. In this paper, we introduce Multi-News, the first large-scale MDS news dataset. Additionally, we propose an end-to-end model which incorporates a traditional extractive summarization model with a standard SDS model and achieves competitive results on MDS datasets. We benchmark several methods on Multi-News and release our data and code in hope that this work will promote advances in summarization in the multi-document setting.

PDF Abstract ACL 2019 PDF ACL 2019 Abstract

Datasets


Introduced in the Paper:

Multi-News

Used in the Paper:

NEWSROOM
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Multi-Document Summarization Multi-News Hi-MAP ROUGE-2 14.89 # 4
ROUGE-1 43.47 # 5
ROUGE-SU4 17.41 # 3

Methods


No methods listed for this paper. Add relevant methods here