Search Results for author: Agathe Balayn

Found 7 papers, 2 papers with code

Hear Me Out: A Study on the Use of the Voice Modality for Crowdsourced Relevance Assessments

no code implementations21 Apr 2023 Nirmal Roy, Agathe Balayn, David Maxwell, Claudia Hauff

The creation of relevance assessments by human assessors (often nowadays crowdworkers) is a vital step when building IR test collections.

Explainability in AI Policies: A Critical Review of Communications, Reports, Regulations, and Standards in the EU, US, and UK

no code implementations20 Apr 2023 Luca Nannini, Agathe Balayn, Adam Leon Smith

This might be due to the willingness to conciliate explanations foremost as a risk management tool for AI oversight, but also due to the lack of a consensus on what constitutes a valid algorithmic explanation, and how feasible the implementation and deployment of such explanations are across stakeholders of an organization.

A.I. Robustness: a Human-Centered Perspective on Technological Challenges and Opportunities

1 code implementation17 Oct 2022 Andrea Tocchetti, Lorenzo Corti, Agathe Balayn, Mireia Yurrita, Philip Lippmann, Marco Brambilla, Jie Yang

Despite the impressive performance of Artificial Intelligence (AI) systems, their robustness remains elusive and constitutes a key issue that impedes large-scale adoption.

Towards a multi-stakeholder value-based assessment framework for algorithmic systems

1 code implementation9 May 2022 Mireia Yurrita, Dave Murray-Rust, Agathe Balayn, Alessandro Bozzon

We, therefore, contribute to current ML auditing practices with an assessment framework that visualizes closeness and tensions between values and we give guidelines on how to operationalize them, while opening up the evaluation and deliberation process to a wide range of stakeholders.


Exploring Data Pipelines through the Process Lens: a Reference Model forComputer Vision

no code implementations5 Jul 2021 Agathe Balayn, Bogdan Kulynych, Seda Guerses

Researchers have identified datasets used for training computer vision (CV) models as an important source of hazardous outcomes, and continue to examine popular CV datasets to expose their harms.

Designing Evaluations of Machine Learning Models for Subjective Inference: The Case of Sentence Toxicity

no code implementations6 Nov 2019 Agathe Balayn, Alessandro Bozzon

Machine Learning (ML) is increasingly applied in real-life scenarios, raising concerns about bias in automatic decision making.

BIG-bench Machine Learning Decision Making +1

Unfairness towards subjective opinions in Machine Learning

no code implementations6 Nov 2019 Agathe Balayn, Alessandro Bozzon, Zoltan Szlavik

Despite the high interest for Machine Learning (ML) in academia and industry, many issues related to the application of ML to real-life problems are yet to be addressed.

BIG-bench Machine Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.