Search Results for author: Devin Willmott

Found 8 papers, 5 papers with code

Leveraging Foundation Models to Improve Lightweight Clients in Federated Learning

no code implementations14 Nov 2023 Xidong Wu, Wan-Yi Lin, Devin Willmott, Filipe Condessa, Yufei Huang, Zhenzhen Li, Madan Ravi Ganesh

Federated Learning (FL) is a distributed training paradigm that enables clients scattered across the world to cooperatively learn a global model without divulging confidential data.

Federated Learning

Understanding the Covariance Structure of Convolutional Filters

no code implementations7 Oct 2022 Asher Trockman, Devin Willmott, J. Zico Kolter

In this work, we first observe that such learned filters have highly-structured covariance matrices, and moreover, we find that covariances calculated from small networks may be used to effectively initialize a variety of larger networks of different depths, widths, patch sizes, and kernel sizes, indicating a degree of model-independence to the covariance structure.

You Only Query Once: Effective Black Box Adversarial Attacks with Minimal Repeated Queries

no code implementations29 Jan 2021 Devin Willmott, Anit Kumar Sahu, Fatemeh Sheikholeslami, Filipe Condessa, Zico Kolter

In this work, we instead show that it is possible to craft (universal) adversarial perturbations in the black-box setting by querying a sequence of different images only once.

Multiplicative Filter Networks

3 code implementations ICLR 2021 Rizal Fathony, Anit Kumar Sahu, Devin Willmott, J Zico Kolter

Although deep networks are typically used to approximate functions over high dimensional inputs, recent work has increased interest in neural networks as function approximators for low-dimensional-but-complex functions, such as representing images as a function of pixel coordinates, solving differential equations, or representing signed distance fields or neural radiance fields.

Simple and Efficient Hard Label Black-box Adversarial Attacks in Low Query Budget Regimes

1 code implementation13 Jul 2020 Satya Narayan Shukla, Anit Kumar Sahu, Devin Willmott, J. Zico Kolter

We focus on the problem of black-box adversarial attacks, where the aim is to generate adversarial examples for deep learning models solely based on information limited to output label~(hard label) to a queried data input.

Bayesian Optimization

Black-box Adversarial Attacks with Bayesian Optimization

1 code implementation30 Sep 2019 Satya Narayan Shukla, Anit Kumar Sahu, Devin Willmott, J. Zico Kolter

We focus on the problem of black-box adversarial attacks, where the aim is to generate adversarial examples using information limited to loss function evaluations of input-output pairs.

Bayesian Optimization

Orthogonal Recurrent Neural Networks with Scaled Cayley Transform

2 code implementations ICML 2018 Kyle Helfrich, Devin Willmott, Qiang Ye

Recurrent Neural Networks (RNNs) are designed to handle sequential data but suffer from vanishing or exploding gradients.

Cannot find the paper you are looking for? You can Submit a new open access paper.