Search Results for author: Kellie Webster

Found 18 papers, 2 papers with code

Flexible text generation for counterfactual fairness probing

no code implementations28 Jun 2022 Zee Fryer, Vera Axelrod, Ben Packer, Alex Beutel, Jilin Chen, Kellie Webster

A common approach for testing fairness issues in text-based classifiers is through the use of counterfactuals: does the classifier output change if a sensitive attribute in the input is changed?

Fairness Text Generation

How to Write a Bias Statement: Recommendations for Submissions to the Workshop on Gender Bias in NLP

no code implementations7 Apr 2021 Christian Hardmeier, Marta R. Costa-jussà, Kellie Webster, Will Radford, Su Lin Blodgett

At the Workshop on Gender Bias in NLP (GeBNLP), we'd like to encourage authors to give explicit consideration to the wider aspects of bias and its social implications.

They, Them, Theirs: Rewriting with Gender-Neutral English

no code implementations12 Feb 2021 Tony Sun, Kellie Webster, Apu Shah, William Yang Wang, Melvin Johnson

Responsible development of technology involves applications being inclusive of the diverse set of users they hope to support.

Benchmark

Type B Reflexivization as an Unambiguous Testbed for Multilingual Multi-Task Gender Bias

1 code implementation EMNLP 2020 Ana Valeria Gonzalez, Maria Barrett, Rasmus Hvingelby, Kellie Webster, Anders Søgaard

The one-sided focus on English in previous studies of gender bias in NLP misses out on opportunities in other languages: English challenge datasets such as GAP and WinoGender highlight model preferences that are "hallucinatory", e. g., disambiguating gender-ambiguous occurrences of 'doctor' as male doctors.

Translation

Scalable Cross Lingual Pivots to Model Pronoun Gender for Translation

no code implementations16 Jun 2020 Kellie Webster, Emily Pitler

Machine translation systems with inadequate document understanding can make errors when translating dropped or neutral pronouns into languages with gendered pronouns (e. g., English).

Machine Translation Translation

Social Biases in NLP Models as Barriers for Persons with Disabilities

no code implementations ACL 2020 Ben Hutchinson, Vinodkumar Prabhakaran, Emily Denton, Kellie Webster, Yu Zhong, Stephen Denuyl

Building equitable and inclusive NLP technologies demands consideration of whether and how social attitudes are represented in ML models.

Sentiment Analysis

Mind the GAP: A Balanced Corpus of Gendered Ambiguous Pronouns

4 code implementations TACL 2018 Kellie Webster, Marta Recasens, Vera Axelrod, Jason Baldridge

Coreference resolution is an important task for natural language understanding, and the resolution of ambiguous pronouns a longstanding challenge.

Coreference Resolution Natural Language Understanding

A Challenge Set and Methods for Noun-Verb Ambiguity

no code implementations EMNLP 2018 Ali Elkahky, Kellie Webster, Daniel Andor, Emily Pitler

English part-of-speech taggers regularly make egregious errors related to noun-verb ambiguity, despite having achieved 97{\%}+ accuracy on the WSJ Penn Treebank since 2002.

Speech Synthesis Text-To-Speech Synthesis +2

Cannot find the paper you are looking for? You can Submit a new open access paper.