Search Results for author: Mikhail Yurochkin

Found 36 papers, 16 papers with code

Your Fairness May Vary: Pretrained Language Model Fairness in Toxic Text Classification

no code implementations29 Sep 2021 Ioana Baldini, Dennis Wei, Karthikeyan Natesan Ramamurthy, Mikhail Yurochkin, Moninder Singh

Through the analysis of more than a dozen pretrained language models of varying sizes on two toxic text classification tasks, we demonstrate that focusing on accuracy measures alone can lead to models with wide variation in fairness characteristics.

Fairness Language Modelling +1

Measuring the sensitivity of Gaussian processes to kernel choice

no code implementations11 Jun 2021 William T. Stephenson, Soumya Ghosh, Tin D. Nguyen, Mikhail Yurochkin, Sameer K. Deshpande, Tamara Broderick

We demonstrate in both synthetic and real-world examples that decisions made with a GP can exhibit substantial sensitivity to kernel choice, even when prior draws are qualitatively interchangeable to a user.

Gaussian Processes

k-Mixup Regularization for Deep Learning via Optimal Transport

no code implementations5 Jun 2021 Kristjan Greenewald, Anming Gu, Mikhail Yurochkin, Justin Solomon, Edward Chien

Mixup is a popular regularization technique for training deep neural networks that can improve generalization and increase adversarial robustness.

Adversarial Robustness

Individually Fair Gradient Boosting

no code implementations ICLR 2021 Alexander Vargo, Fan Zhang, Mikhail Yurochkin, Yuekai Sun

Gradient boosting is a popular method for machine learning from tabular data, which arise often in applications where algorithmic fairness is a concern.

Fairness

Statistical inference for individual fairness

1 code implementation ICLR 2021 Subha Maity, Songkai Xue, Mikhail Yurochkin, Yuekai Sun

As we rely on machine learning (ML) models to make more consequential decisions, the issue of ML models perpetuating or even exacerbating undesirable historical biases (e. g., gender and racial biases) has come to the fore of the public's attention.

Adversarial Attack Fairness

Individually Fair Ranking

no code implementations19 Mar 2021 Amanda Bower, Hamid Eftekhari, Mikhail Yurochkin, Yuekai Sun

We develop an algorithm to train individually fair learning-to-rank (LTR) models.

Fairness Learning-To-Rank

Outlier Robust Optimal Transport

no code implementations1 Jan 2021 Debarghya Mukherjee, Aritra Guha, Justin Solomon, Yuekai Sun, Mikhail Yurochkin

In light of recent advances in solving the OT problem, OT distances are widely used as loss functions in minimum distance estimation.

Outlier Detection

Online Semi-Supervised Learning with Bandit Feedback

no code implementations ICLR Workshop LLD 2019 Sohini Upadhyay, Mikhail Yurochkin, Mayank Agarwal, Yasaman Khazaeni, DjallelBouneffouf

We formulate a new problem at the intersectionof semi-supervised learning and contextual bandits, motivated by several applications including clini-cal trials and ad recommendations.

Imputation Multi-Armed Bandits

There is no trade-off: enforcing fairness can improve accuracy

no code implementations28 Sep 2020 Subha Maity, Debarghya Mukherjee, Mikhail Yurochkin, Yuekai Sun

If the algorithmic biases in an ML model are due to sampling biases in the training data, then enforcing algorithmic fairness may improve the performance of the ML model on unbiased test data.

Fairness

Continuous Regularized Wasserstein Barycenters

1 code implementation NeurIPS 2020 Lingxiao Li, Aude Genevay, Mikhail Yurochkin, Justin Solomon

Leveraging a new dual formulation for the regularized Wasserstein barycenter problem, we introduce a stochastic algorithm that constructs a continuous approximation of the barycenter.

Model Fusion with Kullback--Leibler Divergence

1 code implementation ICML 2020 Sebastian Claici, Mikhail Yurochkin, Soumya Ghosh, Justin Solomon

Our algorithm relies on a mean field assumption for both the fused model and the individual dataset posteriors and proceeds using a simple assign-and-average approach.

Federated Learning Motion Capture

Two Simple Ways to Learn Individual Fairness Metrics from Data

no code implementations19 Jun 2020 Debarghya Mukherjee, Mikhail Yurochkin, Moulinath Banerjee, Yuekai Sun

Individual fairness is an intuitive definition of algorithmic fairness that addresses some of the drawbacks of group fairness.

Fairness

Auditing ML Models for Individual Bias and Unfairness

no code implementations11 Mar 2020 Songkai Xue, Mikhail Yurochkin, Yuekai Sun

We consider the task of auditing ML models for individual bias/unfairness.

Federated Learning with Matched Averaging

1 code implementation ICLR 2020 Hongyi Wang, Mikhail Yurochkin, Yuekai Sun, Dimitris Papailiopoulos, Yasaman Khazaeni

Federated learning allows edge devices to collaboratively learn a shared model while keeping the training data on device, decoupling the ability to do model training from the need to store the data in the cloud.

Federated Learning

Alleviating Label Switching with Optimal Transport

1 code implementation NeurIPS 2019 Pierre Monteiller, Sebastian Claici, Edward Chien, Farzaneh Mirzazadeh, Justin Solomon, Mikhail Yurochkin

Label switching is a phenomenon arising in mixture model posterior inference that prevents one from meaningfully assessing posterior statistics using standard Monte Carlo procedures.

On Efficient Multilevel Clustering via Wasserstein Distances

1 code implementation19 Sep 2019 Viet Huynh, Nhat Ho, Nhan Dam, XuanLong Nguyen, Mikhail Yurochkin, Hung Bui, and Dinh Phung

We propose a novel approach to the problem of multilevel clustering, which aims to simultaneously partition data in each group and discover grouping patterns among groups in a potentially large hierarchically structured corpus of data.

Training individually fair ML models with Sensitive Subspace Robustness

2 code implementations ICLR 2020 Mikhail Yurochkin, Amanda Bower, Yuekai Sun

We consider training machine learning models that are fair in the sense that their performance is invariant under certain sensitive perturbations to the inputs.

Fairness

Hierarchical Optimal Transport for Document Representation

1 code implementation NeurIPS 2019 Mikhail Yurochkin, Sebastian Claici, Edward Chien, Farzaneh Mirzazadeh, Justin Solomon

The ability to measure similarity between documents enables intelligent summarization and analysis of large corpora.

Bayesian Nonparametric Federated Learning of Neural Networks

1 code implementation28 May 2019 Mikhail Yurochkin, Mayank Agarwal, Soumya Ghosh, Kristjan Greenewald, Trong Nghia Hoang, Yasaman Khazaeni

In federated learning problems, data is scattered across different servers and exchanging or pooling it is often impractical or prohibited.

Federated Learning General Classification +1

Dirichlet Simplex Nest and Geometric Inference

1 code implementation27 May 2019 Mikhail Yurochkin, Aritra Guha, Yuekai Sun, XuanLong Nguyen

We propose Dirichlet Simplex Nest, a class of probabilistic models suitable for a variety of data types, and develop fast and provably accurate inference algorithms by accounting for the model's convex geometry and low dimensional simplicial structure.

Probabilistic Federated Neural Matching

no code implementations ICLR 2019 Mikhail Yurochkin, Mayank Agarwal, Soumya Ghosh, Kristjan Greenewald, Nghia Hoang, Yasaman Khazaeni

In federated learning problems, data is scattered across different servers and exchanging or pooling it is often impractical or prohibited.

Federated Learning General Classification +1

Scalable inference of topic evolution via models for latent geometric structures

1 code implementation NeurIPS 2019 Mikhail Yurochkin, Zhiwei Fan, Aritra Guha, Paraschos Koutris, XuanLong Nguyen

We develop new models and algorithms for learning the temporal dynamics of the topic polytopes and related geometric objects that arise in topic model based inference.

UPS: optimizing Undirected Positive Sparse graph for neural graph filtering

no code implementations ICLR 2018 Mikhail Yurochkin, Dung Thai, Hung Hai Bui, XuanLong Nguyen

In this work we propose a novel approach for learning graph representation of the data using gradients obtained via backpropagation.

Multi-way Interacting Regression via Factorization Machines

1 code implementation NeurIPS 2017 Mikhail Yurochkin, XuanLong Nguyen, Nikolaos Vasiloglou

We propose a Bayesian regression method that accounts for multi-way interactions of arbitrary orders among the predictor variables.

Multilevel Clustering via Wasserstein Means

1 code implementation ICML 2017 Nhat Ho, XuanLong Nguyen, Mikhail Yurochkin, Hung Hai Bui, Viet Huynh, Dinh Phung

We propose a novel approach to the problem of multilevel clustering, which aims to simultaneously partition data in each group and discover grouping patterns among groups in a potentially large hierarchically structured corpus of data.

Geometric Dirichlet Means algorithm for topic inference

no code implementations NeurIPS 2016 Mikhail Yurochkin, XuanLong Nguyen

We propose a geometric algorithm for topic learning and inference that is built on the convex geometry of topics arising from the Latent Dirichlet Allocation (LDA) model and its nonparametric extensions.

Variational Inference

Cannot find the paper you are looking for? You can Submit a new open access paper.