Search Results for author:
Found 51 papers, 23 papers with code
Orthogonal Statistical Learning with Self-Concordant Loss
Orthogonal statistical learning and double machine learning have emerged as general frameworks for two-stage statistical prediction in the presence of a nuisance component.
Entropy Regularized Optimal Transport Independence Criterion
We introduce an independence criterion based on entropy regularized optimal transport.
Triangular Flows for Generative Modeling: Statistical Consistency, Smoothness Classes, and Fast Rates
Triangular flows, also known as Kn\"{o}the-Rosenblatt measure couplings, comprise an important building block of normalizing flow models for generative modeling and density estimation, including popular autoregressive flow models such as real-valued non-volume preserving transformation models (Real NVP).
Federated Learning with Heterogeneous Data: A Superquantile Optimization Approach
We present a federated learning framework that is designed to robustly deliver good predictive performance across individual clients with heterogeneous data.
Target Propagation via Regularized Inversion
Target Propagation (TP) algorithms compute targets instead of gradients along neural networks and propagate them backward in a way that is similar yet different than gradient back-propagation (BP).
Stochastic optimization under distributional drift
We consider the problem of minimizing a convex function that is evolving according to unknown and possibly stochastic dynamics, which may depend jointly on time and on the decision variable itself.
Score-Based Change Detection for Gradient-Based Learning Machines
The widespread use of machine learning algorithms calls for automatic change detection algorithms to monitor their behavior over time.
Divergence Frontiers for Generative Models: Sample Complexity, Quantization Effects, and Frontier Integrals
The spectacular success of deep generative models calls for quantitative tools to measure their statistical performance.
Stochastic optimization under time drift: iterate averaging, step-decay schedules, and high probability guarantees
We consider the problem of minimizing a convex function that is evolving in time according to unknown and possibly stochastic dynamics.
MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers
As major progress is made in open-ended text generation, measuring how close machine-generated text is to human language remains a critical open problem.
Differentiable Programming à la Moreau
The notion of a Moreau envelope is central to the analysis of first-order optimization algorithms for machine learning.
Faster Policy Learning with Continuous-Time Gradients
We study the estimation of policy gradients for continuous-time systems with known dynamics.
Asymptotics of Entropy-Regularized Optimal Transport via Chaos Decomposition
We introduce a modification of the commonly used discrete entropic regularization (Cuturi '13) such that the optimal coupling for the regularized problem can be thought of as the static Schr\"odinger bridge with $N$ particles.
First-order Optimization for Superquantile-based Supervised Learning
Classical supervised learning via empirical risk (or negative log-likelihood) minimization hinges upon the assumption that the testing distribution coincides with the training distribution.
Harmonic Decompositions of Convolutional Networks
We present a description of the function space and the smoothness class associated with a convolutional network using the machinery of reproducing kernel Hilbert spaces.
A Spectral Analysis of Dot-product Kernels
We present eigenvalue decay estimates of integral operators associated with compositional dot-product kernels.
Device Heterogeneity in Federated Learning: A Superquantile Approach
We propose a federated learning framework to handle heterogeneous client devices which do not conform to the population data distribution.
An Elementary Approach to Convergence Guarantees of Optimization Algorithms for Deep Networks
We present an approach to obtain convergence guarantees of optimization algorithms for deep networks based on elementary arguments and computations.
Robust Aggregation for Federated Learning
We present a robust aggregation approach to make federated learning robust to settings when a fraction of the devices may be sending corrupted updates to the server.
End-to-end Learning, with or without Labels
We present an approach for end-to-end learning that allows one to jointly learn a feature representation from unlabeled data (with or without labeled data) and predict labels for unlabeled data.
Advances and Open Problems in Federated Learning
FL embodies the principles of focused data collection and minimization, and can mitigate many of the systemic privacy risks and costs resulting from traditional, centralized machine learning and data science approaches.
A Statistical Investigation of Long Memory in Language and Music
Representation and learning of long-range dependencies is a central challenge confronted in modern applications of machine learning to sequence data.
Kernel-based Translations of Convolutional Networks
Convolutional Neural Networks, as most artificial neural networks, are commonly viewed as methods different in essence from kernel-based methods.
A Smoother Way to Train Structured Prediction Models
We present a framework to train a structured prediction model by performing smoothing on the inference algorithm it builds upon.
Object Discovery in Videos as Foreground Motion Clustering
We consider the problem of providing dense segmentation masks for object discovery in videos.
Coupled Recurrent Models for Polyphonic Music Composition
This paper introduces a novel recurrent model for music composition that is tailored to the structure of polyphonic music.
Adaptive Denoising of Signals with Local Shift-Invariant Structure
We discuss the problem of adaptive discrete-time signal denoising in the situation where the signal to be recovered admits a "linear oracle" -- an unknown linear estimate that takes the form of convolution of observations with a time-invariant filter.
Efficient First-Order Algorithms for Adaptive Signal Denoising
Our second contribution is a computational complexity analysis of the proposed procedures, which takes into account their statistical nature and the related notion of statistical accuracy.
Catalyst Acceleration for First-order Convex Optimization: from Theory to Practice
One of the keys to achieve acceleration in theory and in practice is to solve these sub-problems with appropriate accuracy by using the right stopping criterion and the right warm-start strategy.
Invariances and Data Augmentation for Supervised Music Transcription
This paper explores a variety of models for frame-based music transcription, with an emphasis on the methods needed to reach state-of-the-art on human recordings.
Catalyst Acceleration for Gradient-Based Non-Convex Optimization
We introduce a generic scheme to solve nonconvex optimization problems using gradient-based algorithms originally designed for minimizing convex functions.
Learning Features of Music from Scratch
This paper introduces a new large-scale music dataset, MusicNet, to serve as a source of supervision and evaluation of machine learning methods for music research.
Ranked #6 on
Music Transcription
on MusicNet
An Inexact Variable Metric Proximal Point Algorithm for Generic Quasi-Newton Acceleration
We propose an inexact variable-metric proximal point algorithm to accelerate gradient-based optimization algorithms.
Fast and Simple Optimization for Poisson Likelihood Models
Since almost all gradient-based optimization algorithms rely on Lipschitz-continuity, optimizing Poisson likelihood models with a guarantee of convergence can be challenging, especially for large-scale problems.
Structure-Blind Signal Recovery
We consider the problem of recovering a signal observed in Gaussian noise.
Statistics Theory Statistics Theory
Rademacher Complexity Bounds for a Penalized Multiclass Semi-Supervised Algorithm
We propose Rademacher complexity bounds for multiclass classifiers trained with a two-step semi-supervised model.
Convolutional Patch Representations for Image Retrieval: an Unsupervised Approach
Convolutional neural networks (CNNs) have recently received a lot of attention due to their ability to model local stationary structures in natural images in a multi-scale fashion, when learning all model parameters with supervision.
Local Convolutional Features With Unsupervised Training for Image Retrieval
Patch-level descriptors underlie several important computer vision tasks, such as stereo-matching or content-based image retrieval.
Beat-Event Detection in Action Movie Franchises
While important advances were recently made towards temporally localizing and recognizing specific human actions or activities in videos, efficient detection and classification of long video chunks belonging to semantically defined categories such as "pursuit" or "romance" remains challenging. We introduce a new dataset, Action Movie Franchises, consisting of a collection of Hollywood action movie franchises.
Semi-proximal Mirror-Prox for Nonsmooth Composite Minimization
We propose a new first-order optimisation algorithm to solve high-dimensional non-smooth composite minimisation problems.
DeepMatching: Hierarchical Deformable Dense Matching
We introduce a novel matching algorithm, called DeepMatching, to compute dense correspondences between images.
Ranked #4 on
Dense Pixel Correspondence Estimation
on HPatches
Dense Pixel Correspondence Estimation
Optical Flow Estimation
Learning to track for spatio-temporal action localization
We present experimental results for spatio-temporal localization on the UCF-Sports, J-HMDB and UCF-101 action localization datasets, where our approach outperforms the state of the art with a margin of 15%, 7% and 12% respectively in mAP.
Learning to Detect Motion Boundaries
We compare the results obtained with several state-of-the-art optical flow approaches and study the impact of the different cues used in the random forest. Furthermore, we introduce a new dataset, the YouTube Motion Boundaries dataset (YMB), that comprises 60 sequences taken from real-world videos with manually annotated motion boundaries.
Label-Embedding for Image Classification
Attributes act as intermediate representations that enable parameter sharing between classes, a must when training data is scarce.
Ranked #5 on
Zero-Shot Action Recognition
on Kinetics
EpicFlow: Edge-Preserving Interpolation of Correspondences for Optical Flow
We propose a novel approach for optical flow estimation , targeted at large displacements with significant oc-clusions.
Convolutional Kernel Networks
An important goal in visual recognition is to devise image representations that are invariant to particular transformations.
Ranked #24 on
Image Classification
on MNIST
Transformation Pursuit for Image Classification
We propose a principled algorithm Image Transformation Pursuit (ITP) for the automatic selection of a compact set of transformations.
Fast and Robust Archetypal Analysis for Representation Learning
We revisit a pioneer unsupervised learning technique called archetypal analysis, which is related to successful data analysis methods such as sparse coding and non-negative matrix factorization.
On learning to localize objects with minimal supervision
Learning to localize objects with minimal supervision is an important problem in computer vision, since large fully annotated datasets are extremely costly to obtain.
Ranked #30 on
Weakly Supervised Object Detection
on PASCAL VOC 2007
Label-Embedding for Attribute-Based Classification
The label embedding framework offers other advantages such as the ability to leverage alternative sources of information in addition to attributes (e. g. class hierarchies) or to transition smoothly from zero-shot learning to learning with large quantities of data.
Conditional Gradient Algorithms for Norm-Regularized Smooth Convex Optimization
Motivated by some applications in signal processing and machine learning, we consider two convex optimization problems where, given a cone $K$, a norm $\|\cdot\|$ and a smooth convex function $f$, we want either 1) to minimize the norm over the intersection of the cone and a level set of $f$, or 2) to minimize over the cone the sum of $f$ and a multiple of the norm.
