no code implementations • 28 Jan 2022 • Bartłomiej Polaczyk, Jacek Cyranka
Second, we provide a technical result (working also for general approximators) relating solutions of the aforementioned differential inclusion to the (discrete) stochastic gradient descent sequences, hence establishing linear convergence towards zero loss for the stochastic gradient descent iterations.
