no code implementations • 30 Aug 2023 • Daoli Zhu, Lei Zhao, Shuzhong Zhang
In this paper we propose a proximal subgradient method (Prox-SubGrad) for solving nonconvex and nonsmooth optimization problems without assuming Lipschitz continuity conditions.
no code implementations • 2 Jun 2023 • Lei Zhao, Daoli Zhu, Shuzhong Zhang
Under an assumption, to be called the primal-dual variational coherence condition in the paper, we prove the convergence of ALAVI.
no code implementations • 23 May 2023 • Xiao Li, Lei Zhao, Daoli Zhu, Anthony Man-Cho So
In particular, when $f$ is convex, we show $\mathcal{O}(\log(k)/\sqrt{k})$ rate of convergence in terms of the suboptimality gap.
no code implementations • 30 Jun 2022 • Lei Zhao, Ding Chen, Daoli Zhu, Xiao Li
For the case when $f$ is weakly convex and its subdifferential satisfies the global metric subregularity property, we derive the $\mathcal{O}(\varepsilon^{-4})$ iteration complexity in expectation.
no code implementations • 29 Sep 2021 • Lei Zhao, Daoli Zhu, Xiao Li
The large-scale linearly constrained nonsmooth nonconvex optimization finds wide applications in machine learning, including non-PSD Kernel SVM, linearly constrained Lasso with nonsmooth nonconvex penalty, etc.