Search Results for author: Rafael Frongillo

Found 22 papers, 0 papers with code

Forecasting Competitions with Correlated Events

no code implementations24 Mar 2023 Rafael Frongillo, Manuel Lladser, Anish Thilagar, Bo Waggoner

We initiate the study of forecasting competitions for correlated events.

Proper losses for discrete generative models

no code implementations7 Nov 2022 Rafael Frongillo, Dhamma Kimpara, Bo Waggoner

The characterization rules out a loss whose expectation is the cross-entropy between the target distribution and the model.

Consistent Polyhedral Surrogates for Top-$k$ Classification and Variants

no code implementations18 Jul 2022 Jessie Finocchiaro, Rafael Frongillo, Emma Goodwill, Anish Thilagar

For the proposed hinge-like surrogates that are convex (i. e., polyhedral), we apply the recent embedding framework of Finocchiaro et al. (2019; 2022) to determine the prediction problem for which the surrogate is consistent.

Classification Image Classification +2

The Structured Abstain Problem and the Lovász Hinge

no code implementations16 Mar 2022 Jessie Finocchiaro, Rafael Frongillo, Enrique Nueve

The Lov\'asz hinge is a convex surrogate recently proposed for structured binary classification, in which $k$ binary predictions are made simultaneously and the error is judged by a submodular set function.

Binary Classification Image Segmentation +2

No-Regret Learning in Games is Turing Complete

no code implementations24 Feb 2022 Gabriel P. Andrade, Rafael Frongillo, Georgios Piliouras

Games are natural models for multi-agent machine learning settings, such as generative adversarial networks (GANs).

Surrogate Regret Bounds for Polyhedral Losses

no code implementations NeurIPS 2021 Rafael Frongillo, Bo Waggoner

Surrogate risk minimization is an ubiquitous paradigm in supervised machine learning, wherein a target problem is solved by minimizing a surrogate loss on a dataset.

Graphical Economies with Resale

no code implementations28 Jun 2021 Gabriel P. Andrade, Rafael Frongillo, Elliot Gorokhovsky, Sharadha Srinivasan

Kakade, Kearns, and Ortiz (KKO) introduce a graph-theoretic generalization of the classic Arrow--Debreu (AD) exchange economy.

Unifying lower bounds on prediction dimension of convex surrogates

no code implementations NeurIPS 2021 Jessica Finocchiaro, Rafael Frongillo, Bo Waggoner

The convex consistency dimension of a supervised learning task is the lowest prediction dimension $d$ such that there exists a convex surrogate $L : \mathbb{R}^d \times \mathcal Y \to \mathbb R$ that is consistent for the given task.

Open-Ended Question Answering

Learning in Matrix Games can be Arbitrarily Complex

no code implementations5 Mar 2021 Gabriel P. Andrade, Rafael Frongillo, Georgios Piliouras

In this paper we show that, in a strong sense, this dynamic complexity is inherent to games.

BIG-bench Machine Learning

Efficient Competitions and Online Learning with Strategic Forecasters

no code implementations16 Feb 2021 Rafael Frongillo, Robert Gomez, Anish Thilagar, Bo Waggoner

Winner-take-all competitions in forecasting and machine-learning suffer from distorted incentives.

Unifying Lower Bounds on Prediction Dimension of Consistent Convex Surrogates

no code implementations NeurIPS 2021 Jessie Finocchiaro, Rafael Frongillo, Bo Waggoner

Given a prediction task, understanding when one can and cannot design a consistent convex surrogate loss, particularly a low-dimensional one, is an important and active area of machine learning research.

Structured Prediction

Convex Elicitation of Continuous Properties

no code implementations NeurIPS 2018 Jessica Finocchiaro, Rafael Frongillo

A property or statistic of a distribution is said to be elicitable if it can be expressed as the minimizer of some loss function in expectation.

Multi-Observation Regression

no code implementations27 Feb 2018 Rafael Frongillo, Nishant A. Mehta, Tom Morgan, Bo Waggoner

Recent work introduced loss functions which measure the error of a prediction based on multiple simultaneous observations or outcomes.

regression

Multi-Observation Elicitation

no code implementations5 Jun 2017 Sebastian Casalaina-Martin, Rafael Frongillo, Tom Morgan, Bo Waggoner

We study loss functions that measure the accuracy of a prediction based on multiple data points simultaneously.

BIG-bench Machine Learning

Eliciting Categorical Data for Optimal Aggregation

no code implementations NeurIPS 2016 Chien-Ju Ho, Rafael Frongillo, Yi-Ling Chen

Our model generalizes both categories and enables the joint exploration of optimal elicitation and aggregation.

Multiple-choice

Convergence Analysis of Prediction Markets via Randomized Subspace Descent

no code implementations NeurIPS 2015 Rafael Frongillo, Mark D. Reid

However, little is known about rates and guarantees for the convergence of these sequential mechanisms, and two recent papers cite this as an important open question. In this paper we show how some previously studied prediction market trading models can be understood as a natural generalization of randomized coordinate descent which we call randomized subspace descent (RSD).

On Elicitation Complexity

no code implementations NeurIPS 2015 Rafael Frongillo, Ian Kash

Elicitation is the study of statistics or properties which are computable via empirical risk minimization.

A Market Framework for Eliciting Private Data

no code implementations NeurIPS 2015 Bo Waggoner, Rafael Frongillo, Jacob D. Abernethy

We propose a mechanism for purchasing information from a sequence of participants. The participants may simply hold data points they wish to sell, or may have more sophisticated information; either way, they are incentivized to participate as long as they believe their data points are representative or their information will improve the mechanism's future prediction on a test set. The mechanism, which draws on the principles of prediction markets, has a bounded budget and minimizes generalization error for Bregman divergence loss functions. We then show how to modify this mechanism to preserve the privacy of participants' information: At any given time, the current prices and predictions of the mechanism reveal almost no information about any one participant, yet in total over all participants, information is accurately aggregated.

Future prediction

Elicitation Complexity of Statistical Properties

no code implementations23 Jun 2015 Rafael Frongillo, Ian A. Kash

We lay the foundation for a general theory of elicitation complexity, including several basic results about how elicitation complexity behaves, and the complexity of standard properties of interest.

Market Making with Decreasing Utility for Information

no code implementations30 Jul 2014 Miroslav Dudík, Rafael Frongillo, Jennifer Wortman Vaughan

We study information elicitation in cost-function-based combinatorial prediction markets when the market maker's utility for information decreases over time.

How to Hedge an Option Against an Adversary: Black-Scholes Pricing is Minimax Optimal

no code implementations NeurIPS 2013 Jacob Abernethy, Peter L. Bartlett, Rafael Frongillo, Andre Wibisono

We consider a popular problem in finance, option pricing, through the lens of an online learning game between Nature and an Investor.

Cannot find the paper you are looking for? You can Submit a new open access paper.