Search Results for author:
Found 11 papers, 6 papers with code
Revisiting Statistical Laws of Semantic Shift in Romance Cognates
This article revisits statistical relationships across Romance cognates between lexical semantic shift and six intra-linguistic variables, such as frequency and polysemy.
FABLES: Evaluating faithfulness and content selection in book-length summarization
While LLM-based auto-raters have proven reliable for factuality and coherence in other settings, we implement several LLM raters of faithfulness and find that none correlates strongly with human annotations, especially with regard to detecting unfaithful claims.
Aurora-M: The First Open Source Multilingual Language Model Red-teamed according to the U.S. Executive Order
Pretrained language models underpin several AI applications, but their high computational cost for training limits accessibility.
Large language models effectively leverage document-level context for literary translation, but critical errors persist
Large language models (LLMs) are competitive with the state of the art on a wide range of sentence-level translation datasets.
Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense
To increase the robustness of AI-generated text detection to paraphrase attacks, we introduce a simple defense that relies on retrieving semantically-similar generations and must be maintained by a language model API provider.
Exploring Document-Level Literary Machine Translation with Parallel Paragraphs from World Literature
Using Par3, we discover that expert literary translators prefer reference human translations over machine-translated paragraphs at a rate of 84%, while state-of-the-art automatic MT metrics do not correlate with those preferences.
DEMETR: Diagnosing Evaluation Metrics for Translation
While machine translation evaluation metrics based on string overlap (e. g., BLEU) have their limitations, their computations are transparent: the BLEU score assigned to a particular candidate translation can be traced back to the presence or absence of certain words.
ezCoref: Towards Unifying Annotation Guidelines for Coreference Resolution
Large-scale, high-quality corpora are critical for advancing research in coreference resolution.
The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generation
Recent text generation research has increasingly focused on open-ended domains such as story and poetry generation.
NarrativeTime: Dense Temporal Annotation on a Timeline
For the past decade, temporal annotation has been sparse: only a small portion of event pairs in a text was annotated.
Subcharacter Information in Japanese Embeddings: When Is It Worth It?
Languages with logographic writing systems present a difficulty for traditional character-level models.
