no code implementations • 15 Mar 2019 • Lu Lu, Yeonjong Shin, Yanhui Su, George Em. Karniadakis
Numerical examples are provided to demonstrate the effectiveness of the new initialization procedure.
1 code implementation • ICLR 2019 • Lu Lu, Yanhui Su, George Em. Karniadakis
However, here we show that even for such activation, deep and narrow neural networks (NNs) will converge to erroneous mean or median states of the target function depending on the loss with high probability.
