no code implementations • 19 Oct 2023 • Amifa Raj, Michael Ekstrand
These metrics take user browsing behavior into account in their measurement strategies to estimate the attention the user is likely to provide to each item in ranking.
no code implementations • 19 Sep 2023 • Amifa Raj, Michael D. Ekstrand
We examine how fairness scores change with different ranking layouts to yield insights into (1) the consistency of fair ranking measurements across layouts; (2) whether rankings optimized for fairness in a linear ranking remain fair when the results are displayed in a grid; and (3) the impact of column reduction approaches to support different device geometries on fairness measurement.
no code implementations • 25 Apr 2023 • Amifa Raj, Bhaskar Mitra, Nick Craswell, Michael D. Ekstrand
There are many ways a query, the search results, and a demographic attribute such as gender may relate, leading us to hypothesize different causes for these reformulation patterns, such as under-representation on the original result page or based on the linguistic theory of markedness.
no code implementations • 21 Feb 2023 • Michael D. Ekstrand, Graham McDonald, Amifa Raj, Isaac Johnson
The 2021 Fair Ranking track aimed to ensure that documents that are about, or somehow represent, certain protected characteristics receive a fair exposure to the Wikipedia editors, so that the documents have an fair opportunity of being improved and, therefore, be well-represented in Wikipedia.
no code implementations • 11 Feb 2023 • Michael D. Ekstrand, Graham McDonald, Amifa Raj, Isaac Johnson
The 2022 Fair Ranking track aimed to ensure that documents that are about, or somehow represent, certain protected characteristics receive a fair exposure to the Wikipedia editors, so that the documents have an fair opportunity of being improved and, therefore, be well-represented in Wikipedia.
no code implementations • 12 Jan 2023 • Christine Pinney, Amifa Raj, Alex Hanna, Michael D. Ekstrand
Information access research (and development) sometimes makes use of gender, whether to report on the demographics of participants in a user study, as inputs to personalized results or recommendations, or to make systems gender-fair, amongst other purposes.
no code implementations • 28 Jun 2022 • Amifa Raj, Michael D. Ekstrand
Search engines in e-commerce settings allow users to search, browse, and select items from a wide range of products available online including children's items.
no code implementations • 13 May 2021 • Amifa Raj, Ashlee Milton, Michael D. Ekstrand
In this position paper, we argue for the need to investigate if and how gender stereotypes manifest in search and recommender systems. As a starting point, we particularly focus on how these systems may propagate and reinforce gender stereotypes through their results in learning environments, a context where teachers and children in their formative stage regularly interact with these systems.
no code implementations • 2 Sep 2020 • Amifa Raj, Michael D. Ekstrand
Ranked lists are frequently used by information retrieval (IR) systems to present results believed to be relevant to the users information need.