no code implementations • 2 Jun 2021 • Gaspard Lambrechts, Florent De Geeter, Nicolas Vecoven, Damien Ernst, Guillaume Drion
This insight leads to the design of a novel way to initialise any recurrent cell connectivity through a procedure called "warmup" to improve its capability to learn arbitrarily long time dependencies.
3 code implementations • 9 Jun 2020 • Nicolas Vecoven, Damien Ernst, Guillaume Drion
Standard gated cells share a layer internal state to store information at the network level, and long term memory is shaped by network-wide recurrent connection weights.
1 code implementation • 21 Dec 2018 • Nicolas Vecoven, Damien Ernst, Antoine Wehenkel, Guillaume Drion
Animals excel at adapting their intentions, attention, and actions to the environment, making them remarkably efficient at interacting with a rich, unpredictable and ever-changing external world, a property that intelligent machines currently lack.