Search Results for author: Nabeel Seedat

Found 20 papers, 11 papers with code

Dissecting Sample Hardness: A Fine-Grained Analysis of Hardness Characterization Methods for Data-Centric AI

1 code implementation7 Mar 2024 Nabeel Seedat, Fergus Imrie, Mihaela van der Schaar

Additionally, we propose the Hardness Characterization Analysis Toolkit (H-CAT), which supports comprehensive and quantitative benchmarking of HCMs across the hardness taxonomy and can easily be extended to new HCMs, hardness types, and datasets.

Benchmarking

DAGnosis: Localized Identification of Data Inconsistencies using Structures

2 code implementations26 Feb 2024 Nicolas Huynh, Jeroen Berrevoets, Nabeel Seedat, Jonathan Crabbé, Zhaozhi Qian, Mihaela van der Schaar

Identification and appropriate handling of inconsistencies in data at deployment time is crucial to reliably use machine learning models.

Large Language Models to Enhance Bayesian Optimization

1 code implementation6 Feb 2024 Tennison Liu, Nicolás Astorga, Nabeel Seedat, Mihaela van der Schaar

Bayesian optimization (BO) is a powerful approach for optimizing complex and expensive-to-evaluate black-box functions.

Bayesian Optimization Few-Shot Learning

When is Off-Policy Evaluation Useful? A Data-Centric Perspective

no code implementations23 Nov 2023 Hao Sun, Alex J. Chan, Nabeel Seedat, Alihan Hüyük, Mihaela van der Schaar

On the one hand, it brings opportunities for safe policy improvement under high-stakes scenarios like clinical guidelines.

Off-policy evaluation

TRIAGE: Characterizing and auditing training data for improved regression

2 code implementations NeurIPS 2023 Nabeel Seedat, Jonathan Crabbé, Zhaozhi Qian, Mihaela van der Schaar

Data quality is crucial for robust machine learning algorithms, with the recent interest in data-centric AI emphasizing the importance of training data characterization.

regression

U-PASS: an Uncertainty-guided deep learning Pipeline for Automated Sleep Staging

no code implementations7 Jun 2023 Elisabeth R. M. Heremans, Nabeel Seedat, Bertien Buyse, Dries Testelmans, Mihaela van der Schaar, Maarten De Vos

As machine learning becomes increasingly prevalent in critical fields such as healthcare, ensuring the safety and reliability of machine learning systems becomes paramount.

Sleep Staging

Improving Adaptive Conformal Prediction Using Self-Supervised Learning

2 code implementations23 Feb 2023 Nabeel Seedat, Alan Jeffares, Fergus Imrie, Mihaela van der Schaar

However, the use of self-supervision beyond model pretraining and representation learning has been largely unexplored.

Conformal Prediction Prediction Intervals +4

DC-Check: A Data-Centric AI checklist to guide the development of reliable machine learning systems

no code implementations9 Nov 2022 Nabeel Seedat, Fergus Imrie, Mihaela van der Schaar

However, this remains a nascent area with no standardized framework to guide practitioners to the necessary data-centric considerations or to communicate the design of data-centric driven ML systems.

Data-IQ: Characterizing subgroups with heterogeneous outcomes in tabular data

2 code implementations24 Oct 2022 Nabeel Seedat, Jonathan Crabbé, Ioana Bica, Mihaela van der Schaar

High model performance, on average, can hide that models may systematically underperform on subgroups of the data.

Model Selection

Continuous-Time Modeling of Counterfactual Outcomes Using Neural Controlled Differential Equations

2 code implementations16 Jun 2022 Nabeel Seedat, Fergus Imrie, Alexis Bellot, Zhaozhi Qian, Mihaela van der Schaar

To assess solutions to this problem, we propose a controllable simulation environment based on a model of tumor growth for a range of scenarios with irregular sampling reflective of a variety of clinical scenarios.

Causal Inference counterfactual +2

Differentiable and Transportable Structure Learning

1 code implementation13 Jun 2022 Jeroen Berrevoets, Nabeel Seedat, Fergus Imrie, Mihaela van der Schaar

Directed acyclic graphs (DAGs) encode a lot of information about a particular distribution in their structure.

Modeling Disagreement in Automatic Data Labelling for Semi-Supervised Learning in Clinical Natural Language Processing

no code implementations29 May 2022 Hongshu Liu, Nabeel Seedat, Julia Ive

Computational models providing accurate estimates of their uncertainty are crucial for risk management associated with decision making in healthcare contexts.

Decision Making Gaussian Processes +1

Data-SUITE: Data-centric identification of in-distribution incongruous examples

1 code implementation17 Feb 2022 Nabeel Seedat, Jonathan Crabbé, Mihaela van der Schaar

These estimators can be used to evaluate the congruence of test instances with respect to the training set, to answer two practically useful questions: (1) which test instances will be reliably predicted by a model trained with the training instances?

Conformal Prediction Representation Learning

MCU-Net: A framework towards uncertainty representations for decision support system patient referrals in healthcare contexts

1 code implementation8 Jul 2020 Nabeel Seedat

Incorporating a human-in-the-loop system when deploying automated decision support is critical in healthcare contexts to create trust, as well as provide reliable performance on a patient-to-patient basis.

Image Segmentation Medical Image Segmentation +1

Machine learning discrimination of Parkinson's Disease stages from walker-mounted sensors data

no code implementations22 Jun 2020 Nabeel Seedat, Vered Aharonson

A large set of features, some unique to this study are extracted and three feature selection methods are compared using a multi-class Random Forest (RF) classifier.

Attribute BIG-bench Machine Learning +1

Towards calibrated and scalable uncertainty representations for neural networks

no code implementations28 Oct 2019 Nabeel Seedat, Christopher Kanan

For many applications it is critical to know the uncertainty of a neural network's predictions.

Cannot find the paper you are looking for? You can Submit a new open access paper.