Search Results for author: Elan Rosenfeld

Found 15 papers, 2 papers with code

Certified Adversarial Robustness via Randomized Smoothing

10 code implementations8 Feb 2019 Jeremy M Cohen, Elan Rosenfeld, J. Zico Kolter

We show how to turn any classifier that classifies well under Gaussian noise into a new classifier that is certifiably robust to adversarial perturbations under the $\ell_2$ norm.

Adversarial Defense Adversarial Robustness +1

Certified Robustness to Adversarial Label-Flipping Attacks via Randomized Smoothing

no code implementations25 Sep 2019 Elan Rosenfeld, Ezra Winston, Pradeep Ravikumar, J. Zico Kolter

This paper considers label-flipping attacks, a type of data poisoning attack where an adversary relabels a small number of examples in a training set in order to degrade the performance of the resulting classifier.

Binary Classification Data Poisoning

Certified Robustness to Label-Flipping Attacks via Randomized Smoothing

no code implementations ICML 2020 Elan Rosenfeld, Ezra Winston, Pradeep Ravikumar, J. Zico Kolter

Machine learning algorithms are known to be susceptible to data poisoning attacks, where an adversary manipulates the training data to degrade performance of the resulting classifier.

Data Poisoning General Classification +1

Self-Reflective Variational Autoencoder

no code implementations10 Jul 2020 Ifigeneia Apostolopoulou, Elan Rosenfeld, Artur Dubrawski

The Variational Autoencoder (VAE) is a powerful framework for learning probabilistic latent variable generative models.

Variational Inference

The Risks of Invariant Risk Minimization

no code implementations ICLR 2021 Elan Rosenfeld, Pradeep Ravikumar, Andrej Risteski

We furthermore present the very first results in the non-linear regime: we demonstrate that IRM can fail catastrophically unless the test data are sufficiently similar to the training distribution--this is precisely the issue that it was intended to solve.

Out-of-Distribution Generalization

An Online Learning Approach to Interpolation and Extrapolation in Domain Generalization

no code implementations25 Feb 2021 Elan Rosenfeld, Pradeep Ravikumar, Andrej Risteski

A popular assumption for out-of-distribution generalization is that the training data comprises sub-datasets, each drawn from a distinct distribution; the goal is then to "interpolate" these distributions and "extrapolate" beyond them -- this objective is broadly known as domain generalization.

Domain Generalization Out-of-Distribution Generalization

Iterative Feature Matching: Toward Provable Domain Generalization with Logarithmic Environments

no code implementations18 Jun 2021 Yining Chen, Elan Rosenfeld, Mark Sellke, Tengyu Ma, Andrej Risteski

Domain generalization aims at performing well on unseen test environments with data from a limited number of training environments.

Domain Generalization

Deep Attentive Variational Inference

no code implementations ICLR 2022 Ifigeneia Apostolopoulou, Ian Char, Elan Rosenfeld, Artur Dubrawski

Moreover, the architecture for this class of models favors local interactions among the latent variables between neighboring layers when designing the conditioning factors of the involved distributions.

Variational Inference

Analyzing and Improving the Optimization Landscape of Noise-Contrastive Estimation

no code implementations ICLR 2022 Bingbin Liu, Elan Rosenfeld, Pradeep Ravikumar, Andrej Risteski

Noise-contrastive estimation (NCE) is a statistically consistent method for learning unnormalized probabilistic models.

Domain-Adjusted Regression or: ERM May Already Learn Features Sufficient for Out-of-Distribution Generalization

2 code implementations14 Feb 2022 Elan Rosenfeld, Pradeep Ravikumar, Andrej Risteski

Towards this end, we introduce Domain-Adjusted Regression (DARE), a convex objective for learning a linear predictor that is provably robust under a new model of distribution shift.

Domain Generalization Out-of-Distribution Generalization +1

APE: Aligning Pretrained Encoders to Quickly Learn Aligned Multimodal Representations

no code implementations8 Oct 2022 Elan Rosenfeld, Preetum Nakkiran, Hadi Pouransari, Oncel Tuzel, Fartash Faghri

Recent advances in learning aligned multimodal representations have been primarily driven by training large neural networks on massive, noisy paired-modality datasets.

Zero-Shot Learning

Learning Linear Causal Representations from Interventions under General Nonlinear Mixing

no code implementations NeurIPS 2023 Simon Buchholz, Goutham Rajendran, Elan Rosenfeld, Bryon Aragam, Bernhard Schölkopf, Pradeep Ravikumar

We study the problem of learning causal representations from unknown, latent interventions in a general setting, where the latent distribution is Gaussian but the mixing function is completely general.

counterfactual

Identifying Representations for Intervention Extrapolation

no code implementations6 Oct 2023 Sorawit Saengkyongam, Elan Rosenfeld, Pradeep Ravikumar, Niklas Pfister, Jonas Peters

In this paper, we consider the task of intervention extrapolation: predicting how interventions affect an outcome, even when those interventions are not observed at training time, and show that identifiable representations can provide an effective solution to this task even if the interventions affect the outcome non-linearly.

Representation Learning

One-Shot Strategic Classification Under Unknown Costs

no code implementations5 Nov 2023 Elan Rosenfeld, Nir Rosenfeld

The goal of strategic classification is to learn decision rules which are robust to strategic input manipulation.

Classification

Outliers with Opposing Signals Have an Outsized Effect on Neural Network Optimization

no code implementations7 Nov 2023 Elan Rosenfeld, Andrej Risteski

We identify a new phenomenon in neural network optimization which arises from the interaction of depth and a particular heavy-tailed structure in natural data.

Stochastic Optimization

Cannot find the paper you are looking for? You can Submit a new open access paper.