no code implementations • 27 Jan 2023 • Wei Tao, Lei Bao, Sheng Long, Gaowei Wu, Qing Tao
However, for solving this induced optimization problem, the state-of-the-art gradient-based methods such as FGSM, I-FGSM and MI-FGSM look different from their original methods especially in updating the direction, which makes it difficult to understand them and then leaves some theoretical issues to be addressed in viewpoint of optimization.
no code implementations • ICLR 2021 • Wei Tao, Sheng Long, Gaowei Wu, Qing Tao
In this paper, we fill this theory-practice gap by investigating the convergence of the last iterate (referred to as individual convergence), which is a more difficult task than convergence analysis of the averaged solution.
