no code implementations • 16 Nov 2021 • Mohamed Akrout, Douglas Tweed
Why does the Adam optimizer work so well in deep-learning applications?
3 code implementations • NeurIPS 2019 • Mohamed Akrout, Collin Wilson, Peter C. Humphreys, Timothy Lillicrap, Douglas Tweed
Current algorithms for deep learning probably cannot run in the brain because they rely on weight transport, where forward-path neurons transmit their synaptic weights to a feedback path, in a way that is likely impossible biologically.
no code implementations • 15 Nov 2017 • Bita Behrouzi, Xuefei Liu, Douglas Tweed
Many recent algorithms for reinforcement learning are model-free and founded on the Bellman equation.