no code implementations • 20 Jul 2021 • Lin Zhang, Ling Feng, Kan Chen, Choy Heng Lai
Motivated by the edge of chaos principle behind the optimal performance of neural networks, we study the role of various hyperparameters in modern neural network training algorithms in terms of the order-chaos phase diagram.
no code implementations • 11 Sep 2019 • Ling Feng, Lin Zhang, Choy Heng Lai
It has long been suggested that the biological brain operates at some critical point between two different phases, possibly order and chaos.