Search Results for author: Nung Kwan Yip

Found 2 papers, 0 papers with code

A Retrospective Approximation Approach for Smooth Stochastic Optimization

no code implementations7 Mar 2021 David Newton, Raghu Bollapragada, Raghu Pasupathy, Nung Kwan Yip

Our investigation leads naturally to generalizing SG into Retrospective Approximation (RA) where, during each iteration, a "deterministic solver" executes possibly multiple steps on a subsampled deterministic problem and stops when further solving is deemed unnecessary from the standpoint of statistical efficiency.

Image Classification Stochastic Optimization

Towards an Understanding of Residual Networks Using Neural Tangent Hierarchy (NTH)

no code implementations7 Jul 2020 Yuqing Li, Tao Luo, Nung Kwan Yip

Gradient descent yields zero training loss in polynomial time for deep neural networks despite non-convex nature of the objective function.

Cannot find the paper you are looking for? You can Submit a new open access paper.