Towards Interpretable Summary Evaluation via Allocation of Contextual Embeddings to Reference Text Topics

1 code implementation • 25 Oct 2022 • Ben Schaper, Christopher Lohse, Marcell Streile, Andrea Giovannini, Richard Osuala

Despite extensive recent advances in summary generation models, evaluation of auto-generated summaries still widely relies on single-score systems insufficient for transparent assessment and in-depth qualitative analysis.