1 code implementation • 20 Jan 2023 • Khurram Javed, Haseeb Shah, Rich Sutton, Martha White
We show that by either decomposing the network into independent modules or learning the network in stages, we can make RTRL scale linearly with the number of parameters.
1 code implementation • 9 Mar 2021 • Khurram Javed, Martha White, Rich Sutton
We empirically show that as long as connections between columns are sparse, our method approximates the true gradient well.