An Empirical Study of Example Forgetting during Deep Neural Network Learning

ICLR 2019 Mariya TonevaAlessandro SordoniRemi Tachet des CombesAdam TrischlerYoshua BengioGeoffrey J. Gordon

Inspired by the phenomenon of catastrophic forgetting, we investigate the learning dynamics of neural networks as they train on single classification tasks. Our goal is to understand whether a related phenomenon occurs when data does not undergo a clear distributional shift... (read more)

PDF Abstract

Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.