no code implementations • 11 Mar 2024 • Jean V. Alves, Diogo Leitão, Sérgio Jesus, Marco O. P. Sampaio, Javier Liébana, Pedro Saleiro, Mário A. T. Figueiredo, Pedro Bizarro
Learning to defer (L2D) aims to improve human-AI collaboration systems by learning how to defer decisions to humans when they are more likely to be correct than an ML classifier.
no code implementations • 16 Jan 2024 • Ricardo Moreira, Jacopo Bono, Mário Cardoso, Pedro Saleiro, Mário A. T. Figueiredo, Pedro Bizarro
Lastly, explanation methods should be efficient and not compromise the performance of the predictive task.
1 code implementation • 20 Dec 2023 • Jean V. Alves, Diogo Leitão, Sérgio Jesus, Marco O. P. Sampaio, Pedro Saleiro, Mário A. T. Figueiredo, Pedro Bizarro
Financial fraud detection is a high-stakes setting where algorithms and human experts often work in tandem; however, there are no publicly available datasets for L2D concerning this important application of human-AI teaming.
no code implementations • 29 Mar 2023 • José Pombal, Pedro Saleiro, Mário A. T. Figueiredo, Pedro Bizarro
Data valuation is a ML field that studies the value of training instances towards a given predictive task.
no code implementations • 15 Feb 2023 • Ada Martin, Valerie Chen, Sérgio Jesus, Pedro Saleiro
We hope that this work motivates further study of when and how SimEvals should be used to aid in the design of real-world evaluations.
2 code implementations • 24 Nov 2022 • Sérgio Jesus, José Pombal, Duarte Alves, André Cruz, Pedro Saleiro, Rita P. Ribeiro, João Gama, Pedro Bizarro
The suite was generated by applying state-of-the-art tabular data generation techniques on an anonymized, real-world bank account opening fraud detection dataset.
no code implementations • 25 Oct 2022 • Mário Cardoso, Pedro Saleiro, Pedro Bizarro
Reviewing these cases is a cumbersome and complex task that requires analysts to navigate a large network of financial interactions to validate suspicious movements.
1 code implementation • 16 Sep 2022 • André F Cruz, Catarina Belém, Sérgio Jesus, João Bravo, Pedro Saleiro, Pedro Bizarro
Tabular data is prevalent in many high-stakes domains, such as financial services or public policy.
no code implementations • 13 Jul 2022 • José Pombal, André F. Cruz, João Bravo, Pedro Saleiro, Mário A. T. Figueiredo, Pedro Bizarro
The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to incorporate biases embedded within.
no code implementations • 27 Jun 2022 • José Pombal, Pedro Saleiro, Mário A. T. Figueiredo, Pedro Bizarro
The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to incorporate biases embedded within.
no code implementations • 27 Jun 2022 • Diogo Leitão, Pedro Saleiro, Mário A. T. Figueiredo, Pedro Bizarro
Human-AI collaboration (HAIC) in decision-making aims to create synergistic teaming between human decision-makers and AI systems.
no code implementations • 24 Jun 2022 • Kasun Amarasinghe, Kit T. Rodolfa, Sérgio Jesus, Valerie Chen, Vladimir Balayan, Pedro Saleiro, Pedro Bizarro, Ameet Talwalkar, Rayid Ghani
Most existing evaluations of explainable machine learning (ML) methods rely on simplifying assumptions or proxies that do not reflect real-world use cases; the handful of more robust evaluations on real-world settings have shortcomings in their design, resulting in limited conclusions of methods' real-world utility.
no code implementations • 7 May 2022 • João Bento Sousa, Ricardo Moreira, Vladimir Balayan, Pedro Saleiro, Pedro Bizarro
Concept-based explanations aims to fill the model interpretability gap for non-technical humans-in-the-loop.
no code implementations • 26 Apr 2021 • Catarina Belém, Vladimir Balayan, Pedro Saleiro, Pedro Bizarro
In ML-aided decision-making tasks, such as fraud detection or medical diagnosis, the human-in-the-loop, usually a domain-expert without technical ML knowledge, prefers high-level concept-based explanations instead of low-level explanations based on model features.
2 code implementations • 23 Mar 2021 • André F. Cruz, Pedro Saleiro, Catarina Belém, Carlos Soares, Pedro Bizarro
Considerable research effort has been guided towards algorithmic fairness but real-world adoption of bias reduction techniques is still scarce.
no code implementations • 21 Jan 2021 • Sérgio Jesus, Catarina Belém, Vladimir Balayan, João Bento, Pedro Saleiro, Pedro Bizarro, João Gama
We conducted an experiment following XAI Test to evaluate three popular post-hoc explanation methods -- LIME, SHAP, and TreeInterpreter -- on a real-world fraud detection task, with real data, a deployed ML model, and fraud analysts.
Decision Making Explainable Artificial Intelligence (XAI) +1
1 code implementation • 30 Nov 2020 • João Bento, Pedro Saleiro, André F. Cruz, Mário A. T. Figueiredo, Pedro Bizarro
Although recurrent neural networks (RNNs) are state-of-the-art in numerous sequential decision-making tasks, there has been little research on explaining their predictions.
no code implementations • 27 Nov 2020 • Vladimir Balayan, Pedro Saleiro, Catarina Belém, Ludwig Krippahl, Pedro Bizarro
Moreover, we collect the domain feedback from a pool of certified experts and use it to ameliorate the model (human teaching), hence promoting seamless and better suited explanations.
no code implementations • 7 Oct 2020 • André F. Cruz, Pedro Saleiro, Catarina Belém, Carlos Soares, Pedro Bizarro
Hence, coupled with the lack of tools for ML practitioners, real-world adoption of bias reduction methods is still scarce.
2 code implementations • 14 Nov 2018 • Pedro Saleiro, Benedict Kuester, Loren Hinkson, Jesse London, Abby Stevens, Ari Anisfeld, Kit T. Rodolfa, Rayid Ghani
Recent work has raised concerns on the risk of unintended bias in AI systems being used nowadays that can affect individuals unfairly based on race, gender or religion, among other possible characteristics.
no code implementations • 23 Jan 2018 • Pedro Saleiro
Besides E-R retrieval we also believe ORM would benefit of text-based entity-centric prediction capabilities, such as predicting entity popularity on social media based on news events or the outcome of political surveys.
no code implementations • 4 Sep 2017 • Pedro Saleiro, Luís Sarmento, Eduarda Mendes Rodrigues, Carlos Soares, Eugénio Oliveira
Using a single GPU, we were able to scale up vocabulary size from 2048 words embedded and 500K training examples to 32768 words over 10M training examples while keeping a stable validation loss and approximately linear trend on training time per epoch.
2 code implementations • SEMEVAL 2017 • Pedro Saleiro, Eduarda Mendes Rodrigues, Carlos Soares, Eugénio Oliveira
This paper presents the approach developed at the Faculty of Engineering of University of Porto, to participate in SemEval 2017, Task 5: Fine-grained Sentiment Analysis on Financial Microblogs and News.
no code implementations • 31 Oct 2016 • Daniela Ulloa, Pedro Saleiro, Rosaldo J. F. Rossetti, Elis Regina Silva
This work proposes a novel framework for the development of new products and services in transportation through an open innovation approach based on automatic content analysis of social media data.
no code implementations • 1 Jul 2016 • João Oliveira, Mike Pinto, Pedro Saleiro, Jorge Teixeira
Social Media users tend to mention entities when reacting to news events.