Gating creates slow modes and controls phase-space complexity in GRUs and LSTMs

31 Jan 2020Tankut CanKamesh KrishnamurthyDavid J. Schwab

Recurrent neural networks (RNNs) are powerful dynamical models for data with complex temporal structure. However, training RNNs has traditionally proved challenging due to exploding or vanishing of gradients... (read more)

PDF Abstract


No code implementations yet. Submit your code now


Results from the Paper

  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.