1 code implementation • 24 Nov 2021 • Ángel López García-Arias, Masanori Hashimoto, Masato Motomura, Jaehoon Yu
Deep neural networks (DNNs) are so over-parametrized that recent research has found them to already contain a subnetwork with high accuracy at their randomly initialized state.
1 code implementation • 10 Sep 2019 • Zheyu Yan, Yiyu Shi, Wang Liao, Masanori Hashimoto, Xichuan Zhou, Cheng Zhuo
We are then able to analytically explore the weakness of a network and summarize the key findings for the impact of SIPP on different types of bits in a floating point parameter, layer-wise robustness within the same network and impact of network depth.
