no code implementations • 22 Feb 2023 • Andres Ferraro, Gustavo Ferreira, Fernando Diaz, Georgina Born
After demonstrating that existing metrics do not center culture, we introduce a new metric, commonality, that measures the degree to which recommendations familiarize a given user population with specified categories of cultural content.
no code implementations • 22 Feb 2023 • Fernando Diaz, Bhaskar Mitra
In this light, we reflect on the measurement of recall in rankings from a formal perspective.
no code implementations • 29 Dec 2022 • Haolun Wu, Yansen Zhang, Chen Ma, Fuyuan Lyu, Fernando Diaz, Xue Liu
Diversifying search results is an important research topic in retrieval systems in order to satisfy both the various interests of customers and the equal market exposure of providers.
no code implementations • 11 Nov 2022 • Esther Rolf, Ben Packer, Alex Beutel, Fernando Diaz
Building trustworthy, effective, and responsible machine learning systems hinges on understanding how differences in training data and modeling decisions interact to impact predictive performance.
no code implementations • 11 Oct 2022 • Kai Hui, Tao Chen, Zhen Qin, Honglei Zhuang, Fernando Diaz, Mike Bendersky, Don Metzler
Retrieval augmentation has shown promising improvements in different tasks.
1 code implementation • 8 Sep 2022 • Rebecca Salganik, Fernando Diaz, Golnoosh Farnadi
We evaluate two popular GNN methods: Graph Convolutional Network (GCN), which trains on the entire graph, and GraphSAGE, which uses probabilistic random walks to create subgraphs for mini-batch training, and assess the effects of sub-sampling on individual fairness.
no code implementations • 2 Aug 2022 • Andres Ferraro, Gustavo Ferreira, Fernando Diaz, Georgina Born
Recommender systems have become the dominant means of curating cultural content, significantly influencing the nature of individual cultural experience.
no code implementations • 19 May 2022 • Filip Radlinski, Krisztian Balog, Fernando Diaz, Lucas Dixon, Ben Wedin
Natural interaction with recommendation and personalized search systems has received tremendous attention in recent years.
no code implementations • 2 May 2022 • Hamed Zamani, Fernando Diaz, Mostafa Dehghani, Donald Metzler, Michael Bendersky
Although information access systems have long supported people in accomplishing a wide range of tasks, we propose broadening the scope of users of information access systems to include task-driven machines, such as machine learning models.
1 code implementation • 29 Apr 2022 • Haolun Wu, Bhaskar Mitra, Chen Ma, Fernando Diaz, Xue Liu
Prior research on exposure fairness in the context of recommender systems has focused mostly on disparities in the exposure of individual or groups of items to individual users of the system.
no code implementations • 25 Apr 2022 • Fernando Diaz, Andres Ferraro
Offline evaluation of information retrieval and recommendation has traditionally focused on distilling the quality of a ranking into a scalar metric such as average precision or normalized discounted cumulative gain.
no code implementations • 14 Oct 2021 • Ruohan Li, Jianxiang Li, Bhaskar Mitra, Fernando Diaz, Asia J. Biega
Search systems control the exposure of ranked content to searchers.
no code implementations • 11 Aug 2021 • Asia J. Biega, Fernando Diaz, Michael D. Ekstrand, Sergey Feldman, Sebastian Kohlmeier
This paper provides an overview of the NIST TREC 2020 Fair Ranking track.
no code implementations • 11 Aug 2021 • Ömer Kırnap, Fernando Diaz, Asia Biega, Michael Ekstrand, Ben Carterette, Emine Yilmaz
There is increasing attention to evaluating the fairness of search system ranking decisions.
no code implementations • 16 Jul 2021 • Divya Shanmugam, Samira Shabanian, Fernando Diaz, Michèle Finck, Asia Biega
FIDO learns to limit data collection based on an interpretation of data minimization tied to system performance.
no code implementations • 14 Jul 2021 • Mostafa Dehghani, Yi Tay, Alexey A. Gritsenko, Zhe Zhao, Neil Houlsby, Fernando Diaz, Donald Metzler, Oriol Vinyals
The world of empirical machine learning (ML) strongly relies on benchmarks in order to determine the relative effectiveness of different algorithms and methods.
no code implementations • 12 May 2021 • Michael D. Ekstrand, Anubrata Das, Robin Burke, Fernando Diaz
Recommendation, information retrieval, and other information access systems pose unique challenges for investigating and applying the fairness and non-discrimination concepts that have been developed for studying other machine learning systems.
no code implementations • 6 May 2021 • Haolun Wu, Chen Ma, Bhaskar Mitra, Fernando Diaz, Xue Liu
To address these limitations, we propose a multi-objective optimization framework for fairness-aware recommendation, Multi-FR, that adaptively balances accuracy and fairness for various stakeholders with Pareto optimality guarantee.
no code implementations • 18 Jan 2021 • Jaime Arguello, Adam Ferguson, Emery Fine, Bhaskar Mitra, Hamed Zamani, Fernando Diaz
Using movie search as a case study, we explore the characteristics of questions posed by searchers in TOT states in a community question answering website.
no code implementations • 9 Jul 2020 • Timothy J. Hazen, Alexandra Olteanu, Gabriella Kazai, Fernando Diaz, Michael Golebiewski
Past research shows that users benefit from systems that support them in their writing and exploration tasks.
no code implementations • 30 May 2020 • Hamed Zamani, Bhaskar Mitra, Everest Chen, Gord Lueck, Fernando Diaz, Paul N. Bennett, Nick Craswell, Susan T. Dumais
We also propose a model for learning representation for clarifying questions based on the user interaction data as implicit feedback.
no code implementations • 28 May 2020 • Asia J. Biega, Peter Potash, Hal Daumé III, Fernando Diaz, Michèle Finck
Article 5(1)(c) of the European Union's General Data Protection Regulation (GDPR) requires that "personal data shall be [...] adequate, relevant, and limited to what is necessary in relation to the purposes for which they are processed (`data minimisation')".
no code implementations • 27 Apr 2020 • Fernando Diaz, Bhaskar Mitra, Michael D. Ekstrand, Asia J. Biega, Ben Carterette
We introduce the concept of \emph{expected exposure} as the average attention ranked items receive from users over repeated samples of the same query.
no code implementations • 25 Mar 2020 • Asia J. Biega, Fernando Diaz, Michael D. Ekstrand, Sebastian Kohlmeier
The goal of the TREC Fair Ranking track was to develop a benchmark for evaluating retrieval systems in terms of fairness to different content providers in addition to classic notions of relevance.
no code implementations • 8 Jul 2019 • Bhaskar Mitra, Corby Rosset, David Hawking, Nick Craswell, Fernando Diaz, Emine Yilmaz
Deep neural IR models, in contrast, compare the whole query to the document and are, therefore, typically employed only for late stage re-ranking.
1 code implementation • Proceedings of the 26th International Conference on World Wide Web, WWW '17 2017 • Bhaskar Mitra, Fernando Diaz, Nick Craswell
Models such as latent semantic analysis and those based on neural embeddings learn distributed representations of text, and match the query against the document in the latent semantic space.
no code implementations • 7 Sep 2016 • Rahul Goel, Sandeep Soni, Naman Goyal, John Paparrizos, Hanna Wallach, Fernando Diaz, Jacob Eisenstein
Language change is a complex social phenomenon, revealing pathways of communication and sociocultural influence.
no code implementations • ACL 2016 • Fernando Diaz, Bhaskar Mitra, Nick Craswell
Continuous space word embeddings have received a great deal of attention in the natural language processing and machine learning communities for their ability to model term similarity and other relationships.
no code implementations • 12 May 2016 • Chris Kedzie, Fernando Diaz, Kathleen McKeown
We present a system based on sequential decision making for the online summarization of massive document streams, such as those found on the web.
no code implementations • 14 Apr 2016 • Eneko Osaba, Xin-She Yang, Fernando Diaz, Pedro Lopez-Garcia, Roberto Carballedo
Bat algorithm is a population metaheuristic proposed in 2010 which is based on the echolocation or bio-sonar characteristics of microbats.
1 code implementation • 14 Mar 2016 • David Abel, Alekh Agarwal, Fernando Diaz, Akshay Krishnamurthy, Robert E. Schapire
We address both of these challenges with two complementary techniques: First, we develop a gradient-boosting style, non-parametric function approximator for learning on $Q$-function residuals.