no code implementations • 17 Jun 2025 • Alexandra Olteanu, Su Lin Blodgett, Agathe Balayn, Angelina Wang, Fernando Diaz, Flavio du Pin Calmon, Margaret Mitchell, Michael Ekstrand, Reuben Binns, Solon Barocas
In AI research and practice, rigor remains largely understood in terms of methodological rigor -- such as whether mathematical, statistical, or computational methods are correctly applied.
no code implementations • 2 Aug 2024 • Agathe Balayn, Yulu Pi, David Gray Widder, Kars Alfrink, Mireia Yurrita, Sohini Upadhyay, Naveena Karusala, Henrietta Lyons, Cagatay Turkay, Christelle Tessono, Blair Attard-Frost, Ujwal Gadiraju
As an outcome of the workshop, we will synthesize the most pressing opportunities and challenges for contestability along AI value chains in the form of a research roadmap.
no code implementations • 25 May 2024 • Agathe Balayn, Mireia Yurrita, Fanny Rancourt, Fabio Casati, Ujwal Gadiraju
In particular, a limited number of relevant trustors (e. g., end-users) and trustees (i. e., AI systems) have been considered, and empirical explorations have remained in laboratory settings, potentially overlooking factors that impact human-AI relationships in the real world.
no code implementations • 21 Apr 2023 • Nirmal Roy, Agathe Balayn, David Maxwell, Claudia Hauff
The creation of relevance assessments by human assessors (often nowadays crowdworkers) is a vital step when building IR test collections.
no code implementations • 20 Apr 2023 • Luca Nannini, Agathe Balayn, Adam Leon Smith
This might be due to the willingness to conciliate explanations foremost as a risk management tool for AI oversight, but also due to the lack of a consensus on what constitutes a valid algorithmic explanation, and how feasible the implementation and deployment of such explanations are across stakeholders of an organization.
1 code implementation • 17 Oct 2022 • Andrea Tocchetti, Lorenzo Corti, Agathe Balayn, Mireia Yurrita, Philip Lippmann, Marco Brambilla, Jie Yang
Despite the impressive performance of Artificial Intelligence (AI) systems, their robustness remains elusive and constitutes a key issue that impedes large-scale adoption.
1 code implementation • 9 May 2022 • Mireia Yurrita, Dave Murray-Rust, Agathe Balayn, Alessandro Bozzon
We, therefore, contribute to current ML auditing practices with an assessment framework that visualizes closeness and tensions between values and we give guidelines on how to operationalize them, while opening up the evaluation and deliberation process to a wide range of stakeholders.
no code implementations • 5 Jul 2021 • Agathe Balayn, Bogdan Kulynych, Seda Guerses
Researchers have identified datasets used for training computer vision (CV) models as an important source of hazardous outcomes, and continue to examine popular CV datasets to expose their harms.
no code implementations • 6 Nov 2019 • Agathe Balayn, Alessandro Bozzon
Machine Learning (ML) is increasingly applied in real-life scenarios, raising concerns about bias in automatic decision making.
no code implementations • 6 Nov 2019 • Agathe Balayn, Alessandro Bozzon, Zoltan Szlavik
Despite the high interest for Machine Learning (ML) in academia and industry, many issues related to the application of ML to real-life problems are yet to be addressed.