Training Networks in Null Space of Feature Covariance for Continual Learning

1 code implementation • CVPR 2021 • Shipeng Wang, Xiaorong Li, Jian Sun, Zongben Xu

To balance plasticity and stability of network in continual learning, in this paper, we propose a novel network training algorithm called Adam-NSCL, which sequentially optimizes network parameters in the null space of previous tasks.

Continual Learning