no code implementations • 1 Jun 2023 • Juri Opitz, Shira Wein, Julius Steen, Anette Frank, Nathan Schneider
The task of natural language inference (NLI) asks whether a given premise (expressed in NL) entails a given NL hypothesis.
1 code implementation • 26 May 2023 • Julius Steen, Juri Opitz, Anette Frank, Katja Markert
Conditional language models still generate unfaithful output that is not supported by their input.
1 code implementation • COLING 2022 • Julius Steen, Katja Markert
While none of the currently available automatic coherence measures are able to assign reliable coherence scores to system summaries across all evaluation metrics, large-scale language models fine-tuned on self-supervised tasks show promising results, as long as fine-tuning takes into account that they need to generalize across different summary lengths.
1 code implementation • EACL 2021 • Julius Steen, Katja Markert
Manual evaluation is essential to judge progress on automatic text summarization.
no code implementations • WS 2019 • Julius Steen, Katja Markert
In addition, we present the first abstractive oracle experiments for TLS.
no code implementations • LREC 2016 • Yannick Versley, Julius Steen
To ensure portability of NLP systems across multiple domains, existing treebanks are often extended by adding trees from interesting domains that were not part of the initial annotation effort.