Search Results for author: Raphael Gontijo-Lopes

Found 6 papers, 1 papers with code

When does dough become a bagel? Analyzing the remaining mistakes on ImageNet

no code implementations9 May 2022 Vijay Vasudevan, Benjamin Caine, Raphael Gontijo-Lopes, Sara Fridovich-Keil, Rebecca Roelofs

To help contextualize progress on ImageNet and provide a more meaningful evaluation for today's state-of-the-art models, we manually review and categorize every remaining mistake that a few top models make in order to provide insight into the long-tail of errors on one of the most benchmarked datasets in computer vision.

Image Classification

Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time

2 code implementations10 Mar 2022 Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, Rebecca Roelofs, Raphael Gontijo-Lopes, Ari S. Morcos, Hongseok Namkoong, Ali Farhadi, Yair Carmon, Simon Kornblith, Ludwig Schmidt

In this paper, we revisit the second step of this procedure in the context of fine-tuning large pre-trained models, where fine-tuned models often appear to lie in a single low error basin.

 Ranked #1 on Image Classification on ImageNet V2 (using extra training data)

Domain Generalization Image Classification +1

No One Representation to Rule Them All: Overlapping Features of Training Methods

no code implementations ICLR 2022 Raphael Gontijo-Lopes, Yann Dauphin, Ekin D. Cubuk

Despite being able to capture a range of features of the data, high accuracy models trained with supervision tend to make similar predictions.

Contrastive Learning

Spectral Bias in Practice: The Role of Function Frequency in Generalization

no code implementations6 Oct 2021 Sara Fridovich-Keil, Raphael Gontijo-Lopes, Rebecca Roelofs

We also explore the connections between function frequency and image frequency and find that spectral bias is sensitive to the low frequencies prevalent in natural images.

Data Augmentation Image Classification

Tradeoffs in Data Augmentation: An Empirical Study

no code implementations ICLR 2021 Raphael Gontijo-Lopes, Sylvia Smullin, Ekin Dogus Cubuk, Ethan Dyer

Though data augmentation has become a standard component of deep neural network training, the underlying mechanism behind the effectiveness of these techniques remains poorly understood.

Data Augmentation

Affinity and Diversity: Quantifying Mechanisms of Data Augmentation

no code implementations20 Feb 2020 Raphael Gontijo-Lopes, Sylvia J. Smullin, Ekin D. Cubuk, Ethan Dyer

Though data augmentation has become a standard component of deep neural network training, the underlying mechanism behind the effectiveness of these techniques remains poorly understood.

Data Augmentation

Cannot find the paper you are looking for? You can Submit a new open access paper.