Search Results for author: Xiaochuan Gong

Found 1 papers, 1 papers with code

Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis

1 code implementation17 Jan 2024 Jie Hao, Xiaochuan Gong, Mingrui Liu

When the upper-level problem is nonconvex and unbounded smooth, and the lower-level problem is strongly convex, we prove that our algorithm requires $\widetilde{\mathcal{O}}(1/\epsilon^4)$ iterations to find an $\epsilon$-stationary point in the stochastic setting, where each iteration involves calling a stochastic gradient or Hessian-vector product oracle.

Bilevel Optimization Hyperparameter Optimization +3

Cannot find the paper you are looking for? You can Submit a new open access paper.