Search Results for author:
Found 2 papers, 2 papers with code
Dropout as an Implicit Gating Mechanism For Continual Learning
However, it is more reliable to preserve the knowledge it has learned from the previous tasks.
Improved Knowledge Distillation via Teacher Assistant
To alleviate this shortcoming, we introduce multi-step knowledge distillation, which employs an intermediate-sized network (teacher assistant) to bridge the gap between the student and the teacher.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
