no code implementations • NeurIPS 2021 • Ziming Zhang, Yun Yue, Guojun Wu, Yanhua Li, Haichong Zhang
In this paper we consider the training stability of recurrent neural networks (RNNs) and propose a family of RNNs, namely SBO-RNN, that can be formulated using stochastic bilevel optimization (SBO).