Task-driven Discovery of Perceptual Schemas for Generalization in Reinforcement Learning

no code implementations • 29 Sep 2021 • Wilka Torrico Carvalho, Andrew Kyle Lampinen, Kyriacos Nikiforou, Felix Hill, Murray Shanahan

Taking inspiration from cognitive science, we term representations for reoccurring segments of an agent's experience, "perceptual schemas".

Object reinforcement-learning +1

Learning to Represent State with Perceptual Schemata

no code implementations • ICML Workshop URL 2021 • Wilka Torrico Carvalho, Murray Shanahan

We present empirical results that Perceptual Schemata enables a state representation that can maintain multiple objects observed in sequence with independent dynamics while an LSTM cannot.

Zero-shot Generalization