Search Results for author: Laura Gustafson

Found 10 papers, 7 papers with code

FACET: Fairness in Computer Vision Evaluation Benchmark

no code implementations ICCV 2023 Laura Gustafson, Chloe Rolland, Nikhila Ravi, Quentin Duval, Aaron Adcock, Cheng-Yang Fu, Melissa Hall, Candace Ross

We present a new benchmark named FACET (FAirness in Computer Vision EvaluaTion), a large, publicly available evaluation set of 32k images for some of the most common vision tasks - image classification, object detection and segmentation.

Fairness Image Classification +3

Pinpointing Why Object Recognition Performance Degrades Across Income Levels and Geographies

1 code implementation11 Apr 2023 Laura Gustafson, Megan Richards, Melissa Hall, Caner Hazirbas, Diane Bouchacourt, Mark Ibrahim

As an example, we show that mitigating a model's vulnerability to texture can improve performance on the lower income level.

Object Recognition

Towards Reliable Assessments of Demographic Disparities in Multi-Label Image Classifiers

no code implementations16 Feb 2023 Melissa Hall, Bobbie Chern, Laura Gustafson, Denisse Ventura, Harshad Kulkarni, Candace Ross, Nicolas Usunier

These metrics successfully incentivized performance improvements on person-centric tasks such as face analysis and are used to understand risks of modern models.

Fairness Multi-Label Image Classification +1

Vision-Language Models Performing Zero-Shot Tasks Exhibit Gender-based Disparities

no code implementations26 Jan 2023 Melissa Hall, Laura Gustafson, Aaron Adcock, Ishan Misra, Candace Ross

With these capabilities in mind, we ask: Do vision-language models exhibit gender bias when performing zero-shot image classification, object detection and semantic segmentation?

Image Classification object-detection +4

A Systematic Study of Bias Amplification

1 code implementation27 Jan 2022 Melissa Hall, Laurens van der Maaten, Laura Gustafson, Maxwell Jones, Aaron Adcock

To enable this study, we design a simple image-classification problem in which we can tightly control (synthetic) biases.

BIG-bench Machine Learning Image Classification

Forward Prediction for Physical Reasoning

1 code implementation18 Jun 2020 Rohit Girdhar, Laura Gustafson, Aaron Adcock, Laurens van der Maaten

Physical reasoning requires forward prediction: the ability to forecast what will happen next given some initial world state.

Visual Reasoning

PHYRE: A New Benchmark for Physical Reasoning

2 code implementations NeurIPS 2019 Anton Bakhtin, Laurens van der Maaten, Justin Johnson, Laura Gustafson, Ross Girshick

The benchmark is designed to encourage the development of learning algorithms that are sample-efficient and generalize well across puzzles.

Visual Reasoning

Growing Action Spaces

1 code implementation ICML 2020 Gregory Farquhar, Laura Gustafson, Zeming Lin, Shimon Whiteson, Nicolas Usunier, Gabriel Synnaeve

In complex tasks, such as those with large combinatorial action spaces, random exploration may be too inefficient to achieve meaningful learning progress.

reinforcement-learning Reinforcement Learning (RL) +1

Cannot find the paper you are looking for? You can Submit a new open access paper.