Search Results for author:
Found 24 papers, 11 papers with code
Constrained Regeneration for Cross-Lingual Query-Focused Extractive Summarization
Query-focused summaries of foreign-language, retrieved documents can help a user understand whether a document is actually relevant to the query term.
Generating EDU Extracts for Plan-Guided Summary Re-Ranking
Similarly, on 1k samples from CNN / DM, we show that prompting GPT-3 to follow EDU plans outperforms sampling-based methods by 1. 05 ROUGE-2 F1 points.
Whose Opinions Do Language Models Reflect?
Language models (LMs) are increasingly being used in open-ended contexts, where the opinions reflected by LMs in response to subjective queries can have a profound impact, both on user satisfaction, as well as shaping the views of society at large.
Benchmarking Large Language Models for News Summarization
Large language models (LLMs) have shown promise for automatic summarization but the reasons behind their successes are poorly understood.
Tracing and Removing Data Errors in Natural Language Generation Datasets
We show that existing approaches for error tracing, such as gradient-based influence measures, do not perform reliably for detecting faithfulness errors in summarization.
Evaluating Human-Language Model Interaction
Many real-world applications of language models (LMs), such as code autocomplete and writing assistance, involve human-LM interaction.
Holistic Evaluation of Language Models
We present Holistic Evaluation of Language Models (HELM) to improve the transparency of language models.
CREATIVESUMM: Shared Task on Automatic Summarization for Creative Writing
We detail the process of curating these datasets for the task, as well as the metrics used for the evaluation of the submissions.
Novel Chapter Abstractive Summarization using Spinal Tree Aware Sub-Sentential Content Selection
Summarizing novel chapters is a difficult task due to the input length and the fact that sentences that appear in the desired summaries draw content from multiple places throughout the chapter.
Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scale
Machine learning models are now able to convert user-written text descriptions into naturalistic images.
GEMv2: Multilingual NLG Benchmarking in a Single Line of Code
This problem is especially pertinent in natural language generation which requires ever-improving suites of datasets, metrics, and human evaluation to make definitive claims.
ToKen: Task Decomposition and Knowledge Infusion for Few-Shot Hate Speech Detection
Hate speech detection is complex; it relies on commonsense reasoning, knowledge of stereotypes, and an understanding of social nuance that differs from one culture to the next.
Cultural Vocal Bursts Intensity Prediction
Few-Shot Learning
+1
Spurious Correlations in Reference-Free Evaluation of Text Generation
Model-based, reference-free evaluation metrics have been proposed as a fast and cost-effective approach to evaluate Natural Language Generation (NLG) systems.
Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarization
Despite recent progress in abstractive summarization, systems still suffer from faithfulness errors.
On the Opportunities and Risks of Foundation Models
AI is undergoing a paradigm shift with the rise of models (e. g., BERT, DALL-E, GPT-3) that are trained on broad data at scale and are adaptable to a wide range of downstream tasks.
Segmenting Subtitles for Correcting ASR Segmentation Errors
Typical ASR systems segment the input audio into utterances using purely acoustic information, which may not resemble the sentence-like units that are expected by conventional machine translation (MT) systems for Spoken Language Translation.
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
We introduce GEM, a living benchmark for natural language Generation (NLG), its Evaluation, and Metrics.
Ranked #1 on
Extreme Summarization
on GEM-XSum
Abstractive Text Summarization
Cross-Lingual Abstractive Summarization
+5
To BERT or Not to BERT: Comparing Task-specific and Task-agnostic Semi-Supervised Approaches for Sequence Tagging
Leveraging large amounts of unlabeled data using Transformer-like architectures, like BERT, has gained popularity in recent times owing to their effectiveness in learning general representations that can then be further fine-tuned for downstream tasks to much success.
Incorporating Terminology Constraints in Automatic Post-Editing
In this paper, we present both autoregressive and non-autoregressive models for lexically constrained APE, demonstrating that our approach enables preservation of 95% of the terminologies and also improves translation quality on English-German benchmarks.
WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarization
As a set of baselines for further studies, we evaluate the performance of existing cross-lingual abstractive summarization methods on our dataset.
Abstractive Text Summarization
Cross-Lingual Abstractive Summarization
+2
Exploring Content Selection in Summarization of Novel Chapters
We present a new summarization task, generating summaries of novel chapters using summary/chapter pairs from online study guides.
The Role of Pragmatic and Discourse Context in Determining Argument Impact
Research in the social sciences and psychology has shown that the persuasiveness of an argument depends not only the language employed, but also on attributes of the source/communicator, the audience, and the appropriateness and strength of the argument's claims given the pragmatic and discourse context of the argument.
Determining Relative Argument Specificity and Stance for Complex Argumentative Structures
Systems for automatic argument generation and debate require the ability to (1) determine the stance of any claims employed in the argument and (2) assess the specificity of each claim relative to the argument context.
A neural interlingua for multilingual machine translation
We incorporate an explicit neural interlingua into a multilingual encoder-decoder neural machine translation (NMT) architecture.
