no code implementations • 12 Jan 2023 • Christine Pinney, Amifa Raj, Alex Hanna, Michael D. Ekstrand
Information access research (and development) sometimes makes use of gender, whether to report on the demographics of participants in a user study, as inputs to personalized results or recommendations, or to make systems gender-fair, amongst other purposes.
no code implementations • 3 Dec 2021 • Bernard Koch, Emily Denton, Alex Hanna, Jacob G. Foster
Despite the foundational role of benchmarking practices in this field, relatively little attention has been paid to the dynamics of benchmark dataset use and reuse, within or across machine learning subcommunities.
no code implementations • 26 Nov 2021 • Inioluwa Deborah Raji, Emily M. Bender, Amandalynne Paullada, Emily Denton, Alex Hanna
There is a tendency across different subfields in AI to valorize a small collection of influential benchmarks.
no code implementations • 9 Aug 2021 • Morgan Klaus Scheuerman, Emily Denton, Alex Hanna
Specifically, we examine what dataset documentation communicates about the underlying values of vision data and the larger practices and goals of computer vision as a field.
no code implementations • 9 Dec 2020 • Amandalynne Paullada, Inioluwa Deborah Raji, Emily M. Bender, Emily Denton, Alex Hanna
Datasets have played a foundational role in the advancement of machine learning research.
no code implementations • 23 Oct 2020 • Ben Hutchinson, Andrew Smart, Alex Hanna, Emily Denton, Christina Greer, Oddur Kjartansson, Parker Barnes, Margaret Mitchell
In this paper, we introduce a rigorous framework for dataset development transparency which supports decision-making and accountability.
no code implementations • 9 Feb 2020 • Margaret Mitchell, Dylan Baker, Nyalleng Moorosi, Emily Denton, Ben Hutchinson, Alex Hanna, Timnit Gebru, Jamie Morgenstern
The ethical concept of fairness has recently been applied in machine learning (ML) settings to describe a wide range of constraints and objectives.