Search Results for author: Samuel Dooley

Found 21 papers, 11 papers with code

Giraffe: Adventures in Expanding Context Lengths in LLMs

1 code implementation21 Aug 2023 Arka Pal, Deep Karkhanis, Manley Roberts, Samuel Dooley, Arvind Sundararajan, Siddartha Naidu

To use these models on sequences longer than the train-time context length, one might employ techniques from the growing family of context length extrapolation methods -- most of which focus on modifying the system of positional encodings used in the attention mechanism to indicate where tokens or activations are located in the input sequence.

16k 4k

xView: Objects in Context in Overhead Imagery

2 code implementations22 Feb 2018 Darius Lam, Richard Kuzma, Kevin McGee, Samuel Dooley, Michael Laielli, Matthew Klaric, Yaroslav Bulatov, Brendan McCord

We introduce a new large-scale dataset for the advancement of object detection techniques and overhead object detection research.

Object object-detection +1

Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face Recognition

2 code implementations NeurIPS 2023 Samuel Dooley, Rhea Sanjay Sukthanker, John P. Dickerson, Colin White, Frank Hutter, Micah Goldblum

Our search outputs a suite of models which Pareto-dominate all other high-performance architectures and existing bias mitigation methods in terms of accuracy and fairness, often by large margins, on the two most widely used datasets for face identification, CelebA and VGGFace2.

Face Identification Face Recognition +2

Smaug: Fixing Failure Modes of Preference Optimisation with DPO-Positive

1 code implementation20 Feb 2024 Arka Pal, Deep Karkhanis, Samuel Dooley, Manley Roberts, Siddartha Naidu, Colin White

In this work, first we show theoretically that the standard DPO loss can lead to a \textit{reduction} of the model's likelihood of the preferred examples, as long as the relative probability between the preferred and dispreferred classes increases.

PreferenceNet: Encoding Human Preferences in Auction Design with Deep Learning

1 code implementation NeurIPS 2021 Neehar Peri, Michael J. Curry, Samuel Dooley, John P. Dickerson

In addition, we introduce a new metric to evaluate an auction allocations' adherence to such socially desirable constraints and demonstrate that our proposed method is competitive with current state-of-the-art neural-network based auction designs.

Fairness

Fairness Through Robustness: Investigating Robustness Disparity in Deep Learning

1 code implementation17 Jun 2020 Vedant Nanda, Samuel Dooley, Sahil Singla, Soheil Feizi, John P. Dickerson

In this paper, we argue that traditional notions of fairness that are only based on models' outputs are not sufficient when the model is vulnerable to adversarial attacks.

Decision Making Face Recognition +1

Robustness Disparities in Commercial Face Detection

1 code implementation27 Aug 2021 Samuel Dooley, Tom Goldstein, John P. Dickerson

Facial detection and analysis systems have been deployed by large companies and critiqued by scholars and activists for the past decade.

Face Detection

Robustness Disparities in Face Detection

2 code implementations29 Nov 2022 Samuel Dooley, George Z. Wei, Tom Goldstein, John P. Dickerson

Many existing algorithmic audits examine the performance of these systems on later stage elements of facial analysis systems like facial recognition and age, emotion, or perceived gender prediction; however, a core component to these systems has been vastly understudied from a fairness perspective: face detection, sometimes called face localization.

Face Detection Fairness +1

Data Contamination Through the Lens of Time

1 code implementation16 Oct 2023 Manley Roberts, Himanshu Thakur, Christine Herlihy, Colin White, Samuel Dooley

Recent claims about the impressive abilities of large language models (LLMs) are often supported by evaluating publicly available benchmarks.

Multi-objective Differentiable Neural Architecture Search

1 code implementation28 Feb 2024 Rhea Sanjay Sukthanker, Arber Zela, Benedikt Staffler, Samuel Dooley, Josif Grabocka, Frank Hutter

Pareto front profiling in multi-objective optimization (MOO), i. e. finding a diverse set of Pareto optimal solutions, is challenging, especially with expensive objectives like neural network training.

Machine Translation Neural Architecture Search

Overhead Detection: Beyond 8-bits and RGB

no code implementations7 Aug 2018 Eliza Mace, Keith Manville, Monica Barbu-McInnis, Michael Laielli, Matthew Klaric, Samuel Dooley

Specifically, we examine how various features of the data affect building detection accuracy with respect to the Intersection over Union metric.

The Affiliate Matching Problem: On Labor Markets where Firms are Also Interested in the Placement of Previous Workers

no code implementations24 Sep 2020 Samuel Dooley, John P. Dickerson

We model this affiliate matching problem in a generalization of the classic stable marriage setting by permitting firms to state preferences over not just which workers to whom they are matched, but also to which firms their affiliated workers are matched.

Management

ProportionNet: Balancing Fairness and Revenue for Auction Design with Deep Learning

no code implementations13 Oct 2020 Kevin Kuo, Anthony Ostuni, Elizabeth Horishny, Michael J. Curry, Samuel Dooley, Ping-Yeh Chiang, Tom Goldstein, John P. Dickerson

Inspired by these advances, in this paper, we extend techniques for approximating auctions using deep learning to address concerns of fairness while maintaining high revenue and strong incentive guarantees.

Fairness

Comparing Human and Machine Bias in Face Recognition

no code implementations15 Oct 2021 Samuel Dooley, Ryan Downing, George Wei, Nathan Shankar, Bradon Thymes, Gudrun Thorkelsdottir, Tiye Kurtz-Miott, Rachel Mattson, Olufemi Obiwumi, Valeriia Cherepanova, Micah Goldblum, John P Dickerson, Tom Goldstein

Much recent research has uncovered and discussed serious concerns of bias in facial analysis technologies, finding performance disparities between groups of people based on perceived gender, skin type, lighting condition, etc.

Face Recognition

Are Commercial Face Detection Models as Biased as Academic Models?

no code implementations25 Jan 2022 Samuel Dooley, George Z. Wei, Tom Goldstein, John P. Dickerson

When we compare the size of these disparities to that of commercial models, we conclude that commercial models - in contrast to their relatively larger development budget and industry-level fairness commitments - are always as biased or more biased than an academic model.

Face Detection Fairness

The Dichotomous Affiliate Stable Matching Problem: Approval-Based Matching with Applicant-Employer Relations

no code implementations22 Feb 2022 Marina Knittel, Samuel Dooley, John P. Dickerson

We also assume the agent's preferences over entire matchings are determined by a general weighted valuation function of their (and their affiliates') matches.

Topological Data Analysis for Word Sense Disambiguation

no code implementations1 Mar 2022 Michael Rawson, Samuel Dooley, Mithun Bharadwaj, Rishabh Choudhary

We develop and test a novel unsupervised algorithm for word sense induction and disambiguation which uses topological data analysis.

Clustering Topological Data Analysis +2

A Deep Dive into Dataset Imbalance and Bias in Face Identification

no code implementations15 Mar 2022 Valeriia Cherepanova, Steven Reich, Samuel Dooley, Hossein Souri, Micah Goldblum, Tom Goldstein

This is an unfortunate omission, as 'imbalance' is a more complex matter in identification; imbalance may arise in not only the training data, but also the testing data, and furthermore may affect the proportion of identities belonging to each demographic group or the number of images belonging to each identity.

Face Identification Face Recognition +1

How Technology Impacts and Compares to Humans in Socially Consequential Arenas

no code implementations2 Nov 2022 Samuel Dooley

As such, in this work, I make comparative analyses between humans and machines in three scenarios and seek to understand how sentiment about a technology, performance of that technology, and the impacts of that technology combine to influence how one decides to answer my main research question.

Fairer and More Accurate Tabular Models Through NAS

no code implementations18 Oct 2023 Richeek Das, Samuel Dooley

Making models algorithmically fairer in tabular data has been long studied, with techniques typically oriented towards fixes which usually take a neural model with an undesirable outcome and make changes to how the data are ingested, what the model weights are, or how outputs are processed.

Fairness Hyperparameter Optimization +1

Cannot find the paper you are looking for? You can Submit a new open access paper.