Hebbian Deep Learning Without Feedback

1 code implementation • 23 Sep 2022 • Adrien Journé, Hector Garcia Rodriguez, Qinghai Guo, Timoleon Moraitis

Recent approximations to backpropagation (BP) have mitigated many of BP's computational inefficiencies and incompatibilities with biology, but important limitations still remain.

SoftHebb: Bayesian Inference in Unsupervised Hebbian Soft Winner-Take-All Networks

1 code implementation • 12 Jul 2021 • Timoleon Moraitis, Dmitry Toichkin, Adrien Journé, Yansong Chua, Qinghai Guo

All in all, Hebbian efficiency, theoretical underpinning, cross-entropy-minimization, and surprising empirical advantages, suggest that SoftHebb may inspire highly neuromorphic and radically different, but practical and advantageous learning algorithms and hardware accelerators.

Bayesian Inference