1 code implementation • COLING 2022 • Julius Steen, Katja Markert
While none of the currently available automatic coherence measures are able to assign reliable coherence scores to system summaries across all evaluation metrics, large-scale language models fine-tuned on self-supervised tasks show promising results, as long as fine-tuning takes into account that they need to generalize across different summary lengths.
1 code implementation • EACL 2021 • Julius Steen, Katja Markert
Manual evaluation is essential to judge progress on automatic text summarization.
no code implementations • WS 2019 • Julius Steen, Katja Markert
In addition, we present the first abstractive oracle experiments for TLS.
no code implementations • LREC 2016 • Yannick Versley, Julius Steen
To ensure portability of NLP systems across multiple domains, existing treebanks are often extended by adding trees from interesting domains that were not part of the initial annotation effort.