Search Results for author:
Found 7 papers, 3 papers with code
AMR4NLI: Interpretable and robust NLI measures from semantic graphs
The task of natural language inference (NLI) asks whether a given premise (expressed in NL) entails a given NL hypothesis.
With a Little Push, NLI Models can Robustly and Efficiently Predict Faithfulness
Conditional language models still generate unfaithful output that is not supported by their input.
How to Find Strong Summary Coherence Measures? A Toolbox and a Comparative Study for Summary Coherence Measure Evaluation
While none of the currently available automatic coherence measures are able to assign reliable coherence scores to system summaries across all evaluation metrics, large-scale language models fine-tuned on self-supervised tasks show promising results, as long as fine-tuning takes into account that they need to generalize across different summary lengths.
How to Evaluate a Summarizer: Study Design and Statistical Analysis for Manual Linguistic Quality Evaluation
Manual evaluation is essential to judge progress on automatic text summarization.
Abstractive Timeline Summarization
In addition, we present the first abstractive oracle experiments for TLS.
Detecting Annotation Scheme Variation in Out-of-Domain Treebanks
To ensure portability of NLP systems across multiple domains, existing treebanks are often extended by adding trees from interesting domains that were not part of the initial annotation effort.
