Search Results for author: Nadav Hallak

Found 3 papers, 0 papers with code

Regret minimization in stochastic non-convex learning via a proximal-gradient approach

no code implementations13 Oct 2020 Nadav Hallak, Panayotis Mertikopoulos, Volkan Cevher

In this setting, the minimization of external regret is beyond reach for first-order methods, so we focus on a local regret measure defined via a proximal-gradient mapping.

Stochastic Optimization

Efficient Proximal Mapping of the 1-path-norm of Shallow Networks

no code implementations2 Jul 2020 Fabian Latorre, Paul Rolland, Nadav Hallak, Volkan Cevher

We demonstrate two new important properties of the 1-path-norm of shallow neural networks.

On the Almost Sure Convergence of Stochastic Gradient Descent in Non-Convex Problems

no code implementations NeurIPS 2020 Panayotis Mertikopoulos, Nadav Hallak, Ali Kavis, Volkan Cevher

This paper analyzes the trajectories of stochastic gradient descent (SGD) to help understand the algorithm's convergence properties in non-convex problems.

Cannot find the paper you are looking for? You can Submit a new open access paper.