Search Results for author: Kin Gutierrez

Found 2 papers, 0 papers with code

DASGrad: Double Adaptive Stochastic Gradient

no code implementations25 Sep 2019 Kin Gutierrez, Cristian Challu, Jin Li, Artur Dubrawski

Adaptive moment methods have been remarkably successful for optimization under the presence of high dimensional or sparse gradients, in parallel to this, adaptive sampling probabilities for SGD have allowed optimizers to improve convergence rates by prioritizing examples to learn efficiently.

Transfer Learning

Double Adaptive Stochastic Gradient Optimization

no code implementations6 Nov 2018 Kin Gutierrez, Jin Li, Cristian Challu, Artur Dubrawski

We observe that the benefits of~\textsc{DASGrad} increase with the model complexity and variability of the gradients, and we explore the resulting utility in extensions of distribution-matching multitask learning.

Cannot find the paper you are looking for? You can Submit a new open access paper.