Search Results for author: Aurelie C. Lozano

Found 10 papers, 0 papers with code

Adaptive Proximal Gradient Methods for Structured Neural Networks

no code implementations NeurIPS 2021 Jihun Yun, Aurelie C. Lozano, Eunho Yang

We consider the training of structured neural networks where the regularizer can be non-smooth and possibly non-convex.

Quantization

A General Family of Stochastic Proximal Gradient Methods for Deep Learning

no code implementations15 Jul 2020 Jihun Yun, Aurelie C. Lozano, Eunho Yang

We propose a unified framework for stochastic proximal gradient descent, which we term ProxGen, that allows for arbitrary positive preconditioners and lower semi-continuous regularizers.

Quantization

Stochastic Gradient Methods with Block Diagonal Matrix Adaptation

no code implementations26 May 2019 Jihun Yun, Aurelie C. Lozano, Eunho Yang

Extensive experiments reveal that block-diagonal approaches achieve state-of-the-art results on several deep learning tasks, and can outperform adaptive diagonal methods, vanilla Sgd, as well as a modified version of full-matrix adaptation proposed very recently.

Elementary Estimators for Graphical Models

no code implementations NeurIPS 2014 Eunho Yang, Aurelie C. Lozano, Pradeep K. Ravikumar

We propose a class of closed-form estimators for sparsity-structured graphical models, expressed as exponential family distributions, under high-dimensional settings.

Non-parametric Group Orthogonal Matching Pursuit for Sparse Learning with Multiple Kernels

no code implementations NeurIPS 2011 Vikas Sindhwani, Aurelie C. Lozano

We consider regularized risk minimization in a large dictionary of Reproducing kernel Hilbert Spaces (RKHSs) over which the target function has a sparse representation.

Generalization Bounds Sparse Learning

Grouped Orthogonal Matching Pursuit for Variable Selection and Prediction

no code implementations NeurIPS 2009 Grzegorz Swirszcz, Naoki Abe, Aurelie C. Lozano

We consider the problem of variable group selection for least squares regression, namely, that of selecting groups of variables for best regression performance, leveraging and adhering to a natural grouping structure within the explanatory variables.

feature selection regression +1

Cannot find the paper you are looking for? You can Submit a new open access paper.