no code implementations • 14 Oct 2022 • Wenhan Xian, Feihu Huang, Heng Huang
In our theoretical analysis, we prove that our new algorithm achieves a fast convergence rate of $O(\frac{1}{\sqrt{nT}} + \frac{1}{(k/d)^2 T})$ with the communication cost of $O(k \log(d))$ at each iteration.
no code implementations • 23 Apr 2022 • Runxue Bao, Xidong Wu, Wenhan Xian, Heng Huang
To the best of our knowledge, this is the first work of distributed safe dynamic screening method.
no code implementations • NeurIPS 2021 • Wenhan Xian, Feihu Huang, yanfu Zhang, Heng Huang
We prove that our DM-HSGD algorithm achieves stochastic first-order oracle (SFO) complexity of $O(\kappa^3 \epsilon^{-3})$ for decentralized stochastic nonconvex-strongly-concave problem to search an $\epsilon$-stationary point, which improves the exiting best theoretical results.
no code implementations • ICCV 2021 • yanfu Zhang, Lei Luo, Wenhan Xian, Heng Huang
However, pair-wise methods involve expensive training costs, while proxy-based methods are less accurate in characterizing the relationships between data points.