Search Results for author: Daoli Zhu

Found 5 papers, 0 papers with code

A Unified Analysis for the Subgradient Methods Minimizing Composite Nonconvex, Nonsmooth and Non-Lipschitz Functions

no code implementations30 Aug 2023 Daoli Zhu, Lei Zhao, Shuzhong Zhang

In this paper we propose a proximal subgradient method (Prox-SubGrad) for solving nonconvex and nonsmooth optimization problems without assuming Lipschitz continuity conditions.

Stochastic Optimization

An Augmented Lagrangian Approach to Conically Constrained Non-monotone Variational Inequality Problems

no code implementations2 Jun 2023 Lei Zhao, Daoli Zhu, Shuzhong Zhang

Under an assumption, to be called the primal-dual variational coherence condition in the paper, we prove the convergence of ALAVI.

Revisiting Subgradient Method: Complexity and Convergence Beyond Lipschitz Continuity

no code implementations23 May 2023 Xiao Li, Lei Zhao, Daoli Zhu, Anthony Man-Cho So

In particular, when $f$ is convex, we show $\mathcal{O}(\log(k)/\sqrt{k})$ rate of convergence in terms of the suboptimality gap.

Randomized Coordinate Subgradient Method for Nonsmooth Composite Optimization

no code implementations30 Jun 2022 Lei Zhao, Ding Chen, Daoli Zhu, Xiao Li

For the case when $f$ is weakly convex and its subdifferential satisfies the global metric subregularity property, we derive the $\mathcal{O}(\varepsilon^{-4})$ iteration complexity in expectation.

LEMMA

Randomized Primal-Dual Coordinate Method for Large-scale Linearly Constrained Nonsmooth Nonconvex Optimization

no code implementations29 Sep 2021 Lei Zhao, Daoli Zhu, Xiao Li

The large-scale linearly constrained nonsmooth nonconvex optimization finds wide applications in machine learning, including non-PSD Kernel SVM, linearly constrained Lasso with nonsmooth nonconvex penalty, etc.

Cannot find the paper you are looking for? You can Submit a new open access paper.