Search Results for author: Dylan Baker

Found 5 papers, 0 papers with code

D3CODE: Disentangling Disagreements in Data across Cultures on Offensiveness Detection and Evaluation

no code implementations16 Apr 2024 Aida Mostafazadeh Davani, Mark Díaz, Dylan Baker, Vinodkumar Prabhakaran

While human annotations play a crucial role in language technologies, annotator subjectivity has long been overlooked in data collection.

4k

Disentangling Perceptions of Offensiveness: Cultural and Moral Correlates

no code implementations11 Dec 2023 Aida Davani, Mark Díaz, Dylan Baker, Vinodkumar Prabhakaran

More importantly, we find that individual moral values play a crucial role in shaping these variations: moral concerns about Care and Purity are significant mediating factors driving cross-cultural differences.

Evaluating the Social Impact of Generative AI Systems in Systems and Society

no code implementations9 Jun 2023 Irene Solaiman, Zeerak Talat, William Agnew, Lama Ahmad, Dylan Baker, Su Lin Blodgett, Hal Daumé III, Jesse Dodge, Ellie Evans, Sara Hooker, Yacine Jernite, Alexandra Sasha Luccioni, Alberto Lusoli, Margaret Mitchell, Jessica Newman, Marie-Therese Png, Andrew Strait, Apostol Vassilev

We move toward a standard approach in evaluating a generative AI system for any modality, in two overarching categories: what is able to be evaluated in a base system that has no predetermined application and what is able to be evaluated in society.

Detecting Cross-Geographic Biases in Toxicity Modeling on Social Media

no code implementations WNUT (ACL) 2021 Sayan Ghosh, Dylan Baker, David Jurgens, Vinodkumar Prabhakaran

Online social media platforms increasingly rely on Natural Language Processing (NLP) techniques to detect abusive content at scale in order to mitigate the harms it causes to their users.

Bias Detection

Diversity and Inclusion Metrics in Subset Selection

no code implementations9 Feb 2020 Margaret Mitchell, Dylan Baker, Nyalleng Moorosi, Emily Denton, Ben Hutchinson, Alex Hanna, Timnit Gebru, Jamie Morgenstern

The ethical concept of fairness has recently been applied in machine learning (ML) settings to describe a wide range of constraints and objectives.

Fairness

Cannot find the paper you are looking for? You can Submit a new open access paper.