1 code implementation • NeurIPS 2021 • Joseph Pemberton, Ellen Boven, Richard Apps, Rui Ponte Costa
Recently, decoupled neural interfaces (DNIs) were introduced as a solution to the forward and feedback locking problems in deep networks.
no code implementations • 12 May 2021 • Luke Y. Prince, Roy Henha Eyono, Ellen Boven, Arna Ghosh, Joe Pemberton, Franz Scherr, Claudia Clopath, Rui Ponte Costa, Wolfgang Maass, Blake A. Richards, Cristina Savin, Katharina Anna Wilmes
We provide a brief review of the common assumptions about biological learning with findings from experimental neuroscience and contrast them with the efficiency of gradient-based learning in recurrent neural networks.
no code implementations • 1 Jan 2021 • Joseph Pemberton, Ellen Boven, Richard Apps, Rui Ponte Costa
Deep learning methods suffer from similar locking constraints both on the forward and backward phase.