1 code implementation • 22 Jan 2024 • Marlon Becker, Frederick Altrock, Benjamin Risse
The recently proposed optimization algorithm for deep neural networks Sharpness Aware Minimization (SAM) suggests perturbing parameters before gradient calculation by a gradient ascent step to guide the optimization into parameter space regions of flat loss.
no code implementations • 26 Dec 2023 • Henri Tertilt, Jonas Mensing, Marlon Becker, Wilfred G. van der Wiel, Peter A. Bobbert, Andreas Heuer
Third, we quantify the nonlinearity in the distribution of the output current vectors necessary for realizing Boolean functionality by introducing three nonlinearity indicators.
