no code implementations • 1 Jan 2021 • Gege Zhang, Gangwei Li, Weining Shen, Huixin Zhang, Weidong Zhang
Expressivity plays a fundamental role in evaluating deep neural networks, and it is closely related to understanding the limit of performance improvement.
no code implementations • 11 Oct 2019 • Gege Zhang, Gangwei Li, Ningwei Shen, Weidong Zhang
In this paper, we provide a quantitative analysis of the expressivity for the deep neural network (DNN) from its dynamic model, where the Hilbert space is employed to analyze the convergence and criticality.