Search Results for author: Sofia Serrano

Found 5 papers, 1 papers with code

Language Models: A Guide for the Perplexed

no code implementations29 Nov 2023 Sofia Serrano, Zander Brumbaugh, Noah A. Smith

Given the growing importance of AI literacy, we decided to write this tutorial to help narrow the gap between the discourse among those who study language models -- the core technology underlying ChatGPT and similar products -- and those who are intrigued and want to learn more about them.

Language Modelling

Stubborn Lexical Bias in Data and Models

no code implementations3 Jun 2023 Sofia Serrano, Jesse Dodge, Noah A. Smith

Using a new statistical method, we examine whether such spurious patterns in data appear in models trained on the data.

Natural Language Inference

All That's `Human' Is Not Gold: Evaluating Human Evaluation of Generated Text

no code implementations ACL 2021 Elizabeth Clark, Tal August, Sofia Serrano, Nikita Haduong, Suchin Gururangan, Noah A. Smith

Human evaluations are typically considered the gold standard in natural language generation, but as models{'} fluency improves, how well can evaluators detect and judge machine-generated text?

nlg evaluation Text Generation

All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text

no code implementations30 Jun 2021 Elizabeth Clark, Tal August, Sofia Serrano, Nikita Haduong, Suchin Gururangan, Noah A. Smith

Human evaluations are typically considered the gold standard in natural language generation, but as models' fluency improves, how well can evaluators detect and judge machine-generated text?

nlg evaluation Text Generation

Cannot find the paper you are looking for? You can Submit a new open access paper.