no code implementations • 19 Jul 2022 • Reid McIlroy-Young, Jon Kleinberg, Siddhartha Sen, Solon Barocas, Ashton Anderson
An emerging theme in artificial intelligence research is the creation of models to simulate the decisions and behavior of specific people, in domains including game-playing, text generation, and artistic expression.
no code implementations • 14 Jun 2022 • Angelina Wang, Solon Barocas, Kristen Laird, Hanna Wallach
We propose multiple measurement techniques for each type of harm.
1 code implementation • 5 May 2022 • Jessie J. Smith, Saleema Amershi, Solon Barocas, Hanna Wallach, Jennifer Wortman Vaughan
Transparency around limitations can improve the scientific rigor of research, help ensure appropriate interpretation of research findings, and make research claims more credible.
no code implementations • 8 Mar 2022 • Fernando Delgado, Solon Barocas, Karen Levy
Despite growing calls for participation in AI design, there are to date few empirical studies of what these processes look like and how they can be structured for meaningful engagement with domain experts.
no code implementations • 26 May 2021 • Margot Hanley, Solon Barocas, Karen Levy, Shiri Azenkot, Helen Nissenbaum
In this paper, we investigate the ethical dilemmas faced by companies that have adopted the use of computer vision for producing alt text: textual descriptions of images for blind and low vision people, We use Facebook's automatic alt text tool as our primary case study.
no code implementations • 10 Mar 2021 • Solon Barocas, Anhong Guo, Ece Kamar, Jacquelyn Krones, Meredith Ringel Morris, Jennifer Wortman Vaughan, Duncan Wadsworth, Hanna Wallach
Disaggregated evaluations of AI systems, in which system performance is assessed and reported separately for different groups of people, are conceptually simple.
no code implementations • ACL 2020 • Su Lin Blodgett, Solon Barocas, Hal Daum{\'e} III, Hanna Wallach
We survey 146 papers analyzing {``}bias{''} in NLP systems, finding that their motivations are often vague, inconsistent, and lacking in normative reasoning, despite the fact that analyzing {``}bias{''} is an inherently normative process.
1 code implementation • 28 May 2020 • Su Lin Blodgett, Solon Barocas, Hal Daumé III, Hanna Wallach
We survey 146 papers analyzing "bias" in NLP systems, finding that their motivations are often vague, inconsistent, and lacking in normative reasoning, despite the fact that analyzing "bias" is an inherently normative process.
1 code implementation • 21 Jun 2019 • Manish Raghavan, Solon Barocas, Jon Kleinberg, Karen Levy
How are algorithmic assessments built, validated, and examined for bias?