An Evaluation of Progressive Neural Networksfor Transfer Learning in Natural Language Processing

LREC 2020 Abdul MoeedGerhard HagererSumit DugarSarthak GuptaMainak GhoshHannah DannerOliver MitevskiAndreas NawrothGeorg Groh

A major challenge in modern neural networks is the utilization of previous knowledge for new tasks in an effective manner, otherwise known as transfer learning. Fine-tuning, the most widely used method for achieving this, suffers from catastrophic forgetting... (read more)

PDF Abstract

Code


No code implementations yet. Submit your code now

Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods used in the Paper


METHOD TYPE
🤖 No Methods Found Help the community by adding them if they're not listed; e.g. Deep Residual Learning for Image Recognition uses ResNet