no code implementations • 21 Apr 2023 • Nirmal Roy, Agathe Balayn, David Maxwell, Claudia Hauff
The creation of relevance assessments by human assessors (often nowadays crowdworkers) is a vital step when building IR test collections.
no code implementations • 20 Apr 2023 • Luca Nannini, Agathe Balayn, Adam Leon Smith
This might be due to the willingness to conciliate explanations foremost as a risk management tool for AI oversight, but also due to the lack of a consensus on what constitutes a valid algorithmic explanation, and how feasible the implementation and deployment of such explanations are across stakeholders of an organization.
1 code implementation • 17 Oct 2022 • Andrea Tocchetti, Lorenzo Corti, Agathe Balayn, Mireia Yurrita, Philip Lippmann, Marco Brambilla, Jie Yang
Despite the impressive performance of Artificial Intelligence (AI) systems, their robustness remains elusive and constitutes a key issue that impedes large-scale adoption.
1 code implementation • 9 May 2022 • Mireia Yurrita, Dave Murray-Rust, Agathe Balayn, Alessandro Bozzon
We, therefore, contribute to current ML auditing practices with an assessment framework that visualizes closeness and tensions between values and we give guidelines on how to operationalize them, while opening up the evaluation and deliberation process to a wide range of stakeholders.
no code implementations • 5 Jul 2021 • Agathe Balayn, Bogdan Kulynych, Seda Guerses
Researchers have identified datasets used for training computer vision (CV) models as an important source of hazardous outcomes, and continue to examine popular CV datasets to expose their harms.
no code implementations • 6 Nov 2019 • Agathe Balayn, Alessandro Bozzon
Machine Learning (ML) is increasingly applied in real-life scenarios, raising concerns about bias in automatic decision making.
no code implementations • 6 Nov 2019 • Agathe Balayn, Alessandro Bozzon, Zoltan Szlavik
Despite the high interest for Machine Learning (ML) in academia and industry, many issues related to the application of ML to real-life problems are yet to be addressed.