Search Results for author: Pedro Saleiro

Found 25 papers, 7 papers with code

Cost-Sensitive Learning to Defer to Multiple Experts with Workload Constraints

no code implementations11 Mar 2024 Jean V. Alves, Diogo Leitão, Sérgio Jesus, Marco O. P. Sampaio, Javier Liébana, Pedro Saleiro, Mário A. T. Figueiredo, Pedro Bizarro

Learning to defer (L2D) aims to improve human-AI collaboration systems by learning how to defer decisions to humans when they are more likely to be correct than an ML classifier.

Fraud Detection

FiFAR: A Fraud Detection Dataset for Learning to Defer

1 code implementation20 Dec 2023 Jean V. Alves, Diogo Leitão, Sérgio Jesus, Marco O. P. Sampaio, Pedro Saleiro, Mário A. T. Figueiredo, Pedro Bizarro

Financial fraud detection is a high-stakes setting where algorithms and human experts often work in tandem; however, there are no publicly available datasets for L2D concerning this important application of human-AI teaming.

Benchmarking Decision Making +1

Fairness-Aware Data Valuation for Supervised Learning

no code implementations29 Mar 2023 José Pombal, Pedro Saleiro, Mário A. T. Figueiredo, Pedro Bizarro

Data valuation is a ML field that studies the value of training instances towards a given predictive task.

Active Learning Data Valuation +1

A Case Study on Designing Evaluations of ML Explanations with Simulated User Studies

no code implementations15 Feb 2023 Ada Martin, Valerie Chen, Sérgio Jesus, Pedro Saleiro

We hope that this work motivates further study of when and how SimEvals should be used to aid in the design of real-world evaluations.

Decision Making Fraud Detection

Turning the Tables: Biased, Imbalanced, Dynamic Tabular Datasets for ML Evaluation

2 code implementations24 Nov 2022 Sérgio Jesus, José Pombal, Duarte Alves, André Cruz, Pedro Saleiro, Rita P. Ribeiro, João Gama, Pedro Bizarro

The suite was generated by applying state-of-the-art tabular data generation techniques on an anonymized, real-world bank account opening fraud detection dataset.

Fairness Fraud Detection +1

LaundroGraph: Self-Supervised Graph Representation Learning for Anti-Money Laundering

no code implementations25 Oct 2022 Mário Cardoso, Pedro Saleiro, Pedro Bizarro

Reviewing these cases is a cumbersome and complex task that requires analysts to navigate a large network of financial interactions to validate suspicious movements.

Graph Representation Learning Link Prediction +1

FairGBM: Gradient Boosting with Fairness Constraints

1 code implementation16 Sep 2022 André F Cruz, Catarina Belém, Sérgio Jesus, João Bravo, Pedro Saleiro, Pedro Bizarro

Tabular data is prevalent in many high-stakes domains, such as financial services or public policy.

Decision Making Fairness

Understanding Unfairness in Fraud Detection through Model and Data Bias Interactions

no code implementations13 Jul 2022 José Pombal, André F. Cruz, João Bravo, Pedro Saleiro, Mário A. T. Figueiredo, Pedro Bizarro

The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to incorporate biases embedded within.

Decision Making Fairness +1

Prisoners of Their Own Devices: How Models Induce Data Bias in Performative Prediction

no code implementations27 Jun 2022 José Pombal, Pedro Saleiro, Mário A. T. Figueiredo, Pedro Bizarro

The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to incorporate biases embedded within.

Fairness Fraud Detection

Human-AI Collaboration in Decision-Making: Beyond Learning to Defer

no code implementations27 Jun 2022 Diogo Leitão, Pedro Saleiro, Mário A. T. Figueiredo, Pedro Bizarro

Human-AI collaboration (HAIC) in decision-making aims to create synergistic teaming between human decision-makers and AI systems.

Decision Making Fairness +1

On the Importance of Application-Grounded Experimental Design for Evaluating Explainable ML Methods

no code implementations24 Jun 2022 Kasun Amarasinghe, Kit T. Rodolfa, Sérgio Jesus, Valerie Chen, Vladimir Balayan, Pedro Saleiro, Pedro Bizarro, Ameet Talwalkar, Rayid Ghani

Most existing evaluations of explainable machine learning (ML) methods rely on simplifying assumptions or proxies that do not reflect real-world use cases; the handful of more robust evaluations on real-world settings have shortcomings in their design, resulting in limited conclusions of methods' real-world utility.

Experimental Design Fraud Detection

Weakly Supervised Multi-task Learning for Concept-based Explainability

no code implementations26 Apr 2021 Catarina Belém, Vladimir Balayan, Pedro Saleiro, Pedro Bizarro

In ML-aided decision-making tasks, such as fraud detection or medical diagnosis, the human-in-the-loop, usually a domain-expert without technical ML knowledge, prefers high-level concept-based explanations instead of low-level explanations based on model features.

Decision Making Fraud Detection +2

Promoting Fairness through Hyperparameter Optimization

2 code implementations23 Mar 2021 André F. Cruz, Pedro Saleiro, Catarina Belém, Carlos Soares, Pedro Bizarro

Considerable research effort has been guided towards algorithmic fairness but real-world adoption of bias reduction techniques is still scarce.

Fairness Fraud Detection +1

How can I choose an explainer? An Application-grounded Evaluation of Post-hoc Explanations

no code implementations21 Jan 2021 Sérgio Jesus, Catarina Belém, Vladimir Balayan, João Bento, Pedro Saleiro, Pedro Bizarro, João Gama

We conducted an experiment following XAI Test to evaluate three popular post-hoc explanation methods -- LIME, SHAP, and TreeInterpreter -- on a real-world fraud detection task, with real data, a deployed ML model, and fraud analysts.

Decision Making Explainable Artificial Intelligence (XAI) +1

TimeSHAP: Explaining Recurrent Models through Sequence Perturbations

1 code implementation30 Nov 2020 João Bento, Pedro Saleiro, André F. Cruz, Mário A. T. Figueiredo, Pedro Bizarro

Although recurrent neural networks (RNNs) are state-of-the-art in numerous sequential decision-making tasks, there has been little research on explaining their predictions.

Decision Making Feature Importance +3

Teaching the Machine to Explain Itself using Domain Knowledge

no code implementations27 Nov 2020 Vladimir Balayan, Pedro Saleiro, Catarina Belém, Ludwig Krippahl, Pedro Bizarro

Moreover, we collect the domain feedback from a pool of certified experts and use it to ameliorate the model (human teaching), hence promoting seamless and better suited explanations.

Decision Making Fraud Detection

A Bandit-Based Algorithm for Fairness-Aware Hyperparameter Optimization

no code implementations7 Oct 2020 André F. Cruz, Pedro Saleiro, Catarina Belém, Carlos Soares, Pedro Bizarro

Hence, coupled with the lack of tools for ML practitioners, real-world adoption of bias reduction methods is still scarce.

Decision Making Fairness +2

Aequitas: A Bias and Fairness Audit Toolkit

2 code implementations14 Nov 2018 Pedro Saleiro, Benedict Kuester, Loren Hinkson, Jesse London, Abby Stevens, Ari Anisfeld, Kit T. Rodolfa, Rayid Ghani

Recent work has raised concerns on the risk of unintended bias in AI systems being used nowadays that can affect individuals unfairly based on race, gender or religion, among other possible characteristics.

BIG-bench Machine Learning Decision Making +1

Entity Retrieval and Text Mining for Online Reputation Monitoring

no code implementations23 Jan 2018 Pedro Saleiro

Besides E-R retrieval we also believe ORM would benefit of text-based entity-centric prediction capabilities, such as predicting entity popularity on social media based on news events or the outcome of political surveys.

Entity Disambiguation Entity Retrieval +2

Learning Word Embeddings from the Portuguese Twitter Stream: A Study of some Practical Aspects

no code implementations4 Sep 2017 Pedro Saleiro, Luís Sarmento, Eduarda Mendes Rodrigues, Carlos Soares, Eugénio Oliveira

Using a single GPU, we were able to scale up vocabulary size from 2048 words embedded and 500K training examples to 32768 words over 10M training examples while keeping a stable validation loss and approximately linear trend on training time per epoch.

Learning Word Embeddings Playing the Game of 2048

FEUP at SemEval-2017 Task 5: Predicting Sentiment Polarity and Intensity with Financial Word Embeddings

2 code implementations SEMEVAL 2017 Pedro Saleiro, Eduarda Mendes Rodrigues, Carlos Soares, Eugénio Oliveira

This paper presents the approach developed at the Faculty of Engineering of University of Porto, to participate in SemEval 2017, Task 5: Fine-grained Sentiment Analysis on Financial Microblogs and News.

Sentiment Analysis Word Embeddings

Mining Social Media for Open Innovation in Transportation Systems

no code implementations31 Oct 2016 Daniela Ulloa, Pedro Saleiro, Rosaldo J. F. Rossetti, Elis Regina Silva

This work proposes a novel framework for the development of new products and services in transportation through an open innovation approach based on automatic content analysis of social media data.

Sentiment Analysis

Cannot find the paper you are looking for? You can Submit a new open access paper.