no code implementations • 29 Jan 2024 • Yanjie Zhong, Jiaqi Li, Soumendra Lahiri
This paper develops a new dimension-free Azuma-Hoeffding type bound on summation norm of a martingale difference sequence with random individual bounds.
no code implementations • 3 Jun 2023 • Yanjie Zhong, Todd Kuffner, Soumendra Lahiri
Furthermore, our analysis yields an intermediate result: the in-expectation error convergence rate for the original SGD estimator in nonconvex settings, which is comparable to existing results for convex problems.