no code implementations • 21 Dec 2024 • Victor Akinwande, Mohammad Sadegh Norouzzadeh, Devin Willmott, Anna Bair, Madan Ravi Ganesh, J. Zico Kolter
Self-supervised vision-language models trained with contrastive objectives form the basis of current state-of-the-art methods in AI vision tasks.
1 code implementation • 15 Sep 2024 • Dylan Sam, Devin Willmott, Joao D. Semedo, J. Zico Kolter
A notable drawback of CLIP, however, is that the resulting embedding space seems to lack some of the structure of their purely text-based alternatives.
no code implementations • 14 Nov 2023 • Xidong Wu, Wan-Yi Lin, Devin Willmott, Filipe Condessa, Yufei Huang, Zhenzhen Li, Madan Ravi Ganesh
Federated Learning (FL) is a distributed training paradigm that enables clients scattered across the world to cooperatively learn a global model without divulging confidential data.
no code implementations • 7 Oct 2022 • Asher Trockman, Devin Willmott, J. Zico Kolter
In this work, we first observe that such learned filters have highly-structured covariance matrices, and moreover, we find that covariances calculated from small networks may be used to effectively initialize a variety of larger networks of different depths, widths, patch sizes, and kernel sizes, indicating a degree of model-independence to the covariance structure.
no code implementations • 29 Jan 2021 • Devin Willmott, Anit Kumar Sahu, Fatemeh Sheikholeslami, Filipe Condessa, Zico Kolter
In this work, we instead show that it is possible to craft (universal) adversarial perturbations in the black-box setting by querying a sequence of different images only once.
3 code implementations • ICLR 2021 • Rizal Fathony, Anit Kumar Sahu, Devin Willmott, J Zico Kolter
Although deep networks are typically used to approximate functions over high dimensional inputs, recent work has increased interest in neural networks as function approximators for low-dimensional-but-complex functions, such as representing images as a function of pixel coordinates, solving differential equations, or representing signed distance fields or neural radiance fields.
1 code implementation • 13 Aug 2020 • Lars A. Bratholm, Will Gerrard, Brandon Anderson, Shaojie Bai, Sunghwan Choi, Lam Dang, Pavel Hanchar, Addison Howard, Guillaume Huard, Sanghoon Kim, Zico Kolter, Risi Kondor, Mordechai Kornbluth, Youhan Lee, Youngsoo Lee, Jonathan P. Mailoa, Thanh Tu Nguyen, Milos Popovic, Goran Rakocevic, Walter Reade, Wonho Song, Luka Stojanovic, Erik H. Thiede, Nebojsa Tijanic, Andres Torrubia, Devin Willmott, Craig P. Butts, David R. Glowacki, Kaggle participants
The rise of machine learning (ML) has created an explosion in the potential strategies for using data to make scientific predictions.
Ranked #1 on
NMR J-coupling
on QM9
1 code implementation • 13 Jul 2020 • Satya Narayan Shukla, Anit Kumar Sahu, Devin Willmott, J. Zico Kolter
We focus on the problem of black-box adversarial attacks, where the aim is to generate adversarial examples for deep learning models solely based on information limited to output label~(hard label) to a queried data input.
1 code implementation • 30 Sep 2019 • Satya Narayan Shukla, Anit Kumar Sahu, Devin Willmott, J. Zico Kolter
We focus on the problem of black-box adversarial attacks, where the aim is to generate adversarial examples using information limited to loss function evaluations of input-output pairs.
2 code implementations • ICML 2018 • Kyle Helfrich, Devin Willmott, Qiang Ye
Recurrent Neural Networks (RNNs) are designed to handle sequential data but suffer from vanishing or exploding gradients.