On the Transferability of Representations in Neural Networks Between Datasets and Tasks

no code implementations • 29 Nov 2018 • Haytham M. Fayek, Lawrence Cavedon, Hong Ren Wu

Deep networks, composed of multiple layers of hierarchical distributed representations, tend to learn low-level features in initial layers and transition to high-level features towards final layers.

Continual Learning Multi-Task Learning