no code implementations • 27 Dec 2024 • Yuxin Chang, Alex Boyd, Cao Xiao, Taha Kass-Hout, Parminder Bhatia, Padhraic Smyth, Andrew Warrington
Marked temporal point processes (MTPPs) are used to model sequences of different types of events with irregular arrival times, with broad applications ranging from healthcare and social networks to finance.
no code implementations • 31 Oct 2024 • Rachel Longjohn, Markelle Kelly, Sameer Singh, Padhraic Smyth
In machine learning research, it is common to evaluate algorithms via their performance on standard benchmark datasets.
1 code implementation • 30 Oct 2024 • Ola Rønning, Eric Nalisnick, Christophe Ley, Padhraic Smyth, Thomas Hamelryck
Stein variational gradient descent (SVGD) [Liu and Wang, 2016] performs approximate Bayesian inference by representing the posterior with a set of particles.
no code implementations • 9 Oct 2024 • Gavin Kerrigan, Kai Nelson, Padhraic Smyth
Continuous-time event sequences, in which events occur at irregular intervals, are ubiquitous across a wide range of industrial and scientific domains.
1 code implementation • 22 Jul 2024 • Catarina G Belem, Markelle Kelly, Mark Steyvers, Sameer Singh, Padhraic Smyth
We find that 7 out of 10 models are able to map uncertainty expressions to probabilistic responses in a human-like manner.
no code implementations • 8 Jul 2024 • Eshant English, Eliot Wong-Toi, Matteo Fontana, Stephan Mandt, Padhraic Smyth, Christoph Lippert
Conformal prediction provides machine learning models with prediction sets that offer theoretical guarantees, but the underlying assumption of exchangeability limits its applicability to time series data.
no code implementations • 24 Jun 2024 • Aodong Li, Yunhan Zhao, Chen Qiu, Marius Kloft, Padhraic Smyth, Maja Rudolph, Stephan Mandt
Large language models (LLMs) have shown their potential in long-context understanding and mathematical reasoning.
1 code implementation • 5 Apr 2024 • Gavin Kerrigan, Giosue Migliorini, Padhraic Smyth
We study the geometry of conditional optimal transport (COT) and prove a dynamical formulation which generalizes the Benamou-Brenier Theorem.
no code implementations • 24 Jan 2024 • Mark Steyvers, Heliodoro Tejeda, Aakriti Kumar, Catarina Belem, Sheer Karny, Xinyue Hu, Lukas Mayer, Padhraic Smyth
Here we explore the calibration gap, which refers to the difference between human confidence in LLM-generated answers and the models' actual confidence, and the discrimination gap, which reflects how well humans and models can distinguish between correct and incorrect answers.
1 code implementation • 22 Dec 2023 • Yuxin Chang, Alex Boyd, Padhraic Smyth
In this work, we develop a general framework for modeling set-valued data in continuous-time, compatible with any intensity-based recurrent neural point process model.
no code implementations • 12 Dec 2023 • Sam Showalter, Alex Boyd, Padhraic Smyth, Mark Steyvers
Given a pre-trained classifier and multiple human experts, we investigate the task of online classification where model predictions are provided for free but querying humans incurs a cost.
1 code implementation • 26 May 2023 • Gavin Kerrigan, Giosue Migliorini, Padhraic Smyth
We propose Functional Flow Matching (FFM), a function-space generative model that generalizes the recently-introduced Flow Matching model to operate in infinite-dimensional spaces.
1 code implementation • 15 May 2023 • Markelle Kelly, Aakriti Kumar, Padhraic Smyth, Mark Steyvers
Improving our understanding of how humans perceive AI teammates is an important foundation for our general understanding of human-AI teams.
1 code implementation • NeurIPS 2023 • Aodong Li, Chen Qiu, Marius Kloft, Padhraic Smyth, Maja Rudolph, Stephan Mandt
Anomaly detection (AD) plays a crucial role in many safety-critical application domains.
Ranked #1 on
Unsupervised Anomaly Detection
on AnoShift
Unsupervised Anomaly Detection
zero-shot anomaly detection
+1
1 code implementation • 15 Feb 2023 • Aodong Li, Chen Qiu, Marius Kloft, Padhraic Smyth, Stephan Mandt, Maja Rudolph
Selecting informative data points for expert feedback can significantly improve the performance of anomaly detection (AD) in various contexts, such as medical diagnostics or fraud detection.
1 code implementation • 1 Dec 2022 • Gavin Kerrigan, Justin Ley, Padhraic Smyth
We generalize diffusion models to operate directly in function space by developing the foundational theory for such models in terms of Gaussian measures on Hilbert spaces.
no code implementations • 15 Nov 2022 • Alex Boyd, Yuxin Chang, Stephan Mandt, Padhraic Smyth
Continuous-time event sequences, i. e., sequences consisting of continuous time stamps and associated event types ("marks"), are an important type of sequential data with many applications, e. g., in clinical medicine or user behavior modeling.
1 code implementation • 12 Oct 2022 • Alex Boyd, Sam Showalter, Stephan Mandt, Padhraic Smyth
In reasoning about sequential events it is natural to pose probabilistic queries such as "when will event A occur next" or "what is the probability of A occurring before B", with applications in areas such as user modeling, medicine, and finance.
1 code implementation • 30 Sep 2022 • Markelle Kelly, Padhraic Smyth
In this paper we introduce the notion of variable-based calibration to characterize calibration properties of a model with respect to a variable of interest, generalizing traditional score-based metrics such as expected calibration error (ECE).
1 code implementation • 18 Jun 2022 • Hyungrok Do, Preston Putzel, Axel Martin, Padhraic Smyth, Judy Zhong
In addition, we demonstrate that the fair GLM can generate fair predictions for a range of response variables, other than binary and continuous outcomes.
1 code implementation • NeurIPS 2021 • Gavin Kerrigan, Padhraic Smyth, Mark Steyvers
An increasingly common use case for machine learning models is augmenting the abilities of human decision makers.
no code implementations • 12 May 2021 • Tijl De Bie, Luc De Raedt, José Hernández-Orallo, Holger H. Hoos, Padhraic Smyth, Christopher K. I. Williams
Given the complexity of typical data science projects and the associated demand for human expertise, automation has the potential to transform the data science process.
1 code implementation • NeurIPS 2021 • Aodong Li, Alex Boyd, Padhraic Smyth, Stephan Mandt
We consider the problem of online learning in the presence of distribution shifts that occur at an unknown rate and of unknown intensity.
no code implementations • pproximateinference AABI Symposium 2021 • Aodong Li, Alex James Boyd, Padhraic Smyth, Stephan Mandt
We consider the problem of online learning in the presence of sudden distribution shifts, which may be hard to detect and can lead to a slow but steady degradation in model performance.
1 code implementation • NeurIPS 2020 • Alex Boyd, Robert Bamler, Stephan Mandt, Padhraic Smyth
Modeling such data can be very challenging, in particular for applications with many different types of events, since it requires a model to predict the event types as well as the time of occurrence.
no code implementations • NeurIPS 2020 • Disi Ji, Padhraic Smyth, Mark Steyvers
We investigate the problem of reliably assessing group fairness when labeled examples are few but unlabeled examples are plentiful.
1 code implementation • 16 Feb 2020 • Disi Ji, Robert L. Logan IV, Padhraic Smyth, Mark Steyvers
Recent advances in machine learning have led to increased deployment of black-box classifiers across a wide variety of applications.
1 code implementation • 9 Oct 2018 • Eric Nalisnick, José Miguel Hernández-Lobato, Padhraic Smyth
We propose a novel framework for understanding multiplicative noise in neural networks, considering continuous distributions as well as Bernoulli noise (i. e. dropout).
no code implementations • 21 Nov 2017 • Disi Ji, Eric Nalisnick, Padhraic Smyth
Analysis of flow cytometry data is an essential tool for clinical diagnosis of hematological and immunological conditions.
no code implementations • 4 Apr 2017 • Eric Nalisnick, Padhraic Smyth
Informative Bayesian priors are often difficult to elicit, and when this is the case, modelers usually turn to noninformative or objective priors.
no code implementations • 11 Jan 2017 • Tracy Holsclaw, Arthur M. Greene, Andrew W. Robertson, Padhraic Smyth
We extend such models to introduce additional non-homogeneity into the emission distribution using a generalized linear model (GLM), with data augmentation for sampling-based inference.
2 code implementations • 20 May 2016 • Eric Nalisnick, Padhraic Smyth
We extend Stochastic Gradient Variational Bayes to perform posterior inference for the weights of Stick-Breaking processes.
no code implementations • 10 Jun 2015 • Eric Nalisnick, Anima Anandkumar, Padhraic Smyth
Corrupting the input and hidden layers of deep neural networks (DNNs) with multiplicative noise, often drawn from the Bernoulli distribution (or 'dropout'), provides regularization that has significantly contributed to deep learning's success.
no code implementations • 20 Dec 2014 • Kevin Bache, Dennis Decoste, Padhraic Smyth
We describe a general framework for online adaptation of optimization hyperparameters by `hot swapping' their values during learning.
no code implementations • 10 May 2013 • James Foulds, Levi Boyles, Christopher DuBois, Padhraic Smyth, Max Welling
We propose a stochastic algorithm for collapsed variational Bayesian inference for LDA, which is simpler and more efficient than the state of the art method.
1 code implementation • 11 Jul 2012 • Michal Rosen-Zvi, Thomas Griffiths, Mark Steyvers, Padhraic Smyth
A document with multiple authors is modeled as a distribution over topics that is a mixture of the distributions associated with the authors.
1 code implementation • 9 May 2012 • Arthur Asuncion, Max Welling, Padhraic Smyth, Yee Whye Teh
Latent Dirichlet analysis, or topic modeling, is a flexible latent variable framework for modeling high-dimensional sparse count data.
no code implementations • NeurIPS 2011 • Duy Q. Vu, David Hunter, Padhraic Smyth, Arthur U. Asuncion
The development of statistical models for continuous-time longitudinal network data is of increasing interest in machine learning and social science.
no code implementations • NeurIPS 2010 • America Chambers, Padhraic Smyth, Mark Steyvers
We describe a generative model that is based on a stick-breaking process for graphs, and a Markov Chain Monte Carlo inference procedure.
no code implementations • NeurIPS 2009 • Andrew Frank, Padhraic Smyth, Alexander T. Ihler
Since the development of loopy belief propagation, there has been considerable work on advancing the state of the art for approximate inference over distributions defined on discrete random variables.
no code implementations • NeurIPS 2008 • Padhraic Smyth, Max Welling, Arthur U. Asuncion
Distributed learning is a problem of fundamental interest in machine learning and cognitive science.