The Information Complexity of Learning Tasks, their Structure and their Distance

no code implementations • 5 Apr 2019 • Alessandro Achille, Giovanni Paolini, Glen Mbeng, Stefano Soatto

Our framework is the first to measure complexity in a way that accounts for the effect of the optimization scheme, which is critical in Deep Learning.

Memorization Transfer Learning

Dynamics and Reachability of Learning Tasks

no code implementations • 4 Oct 2018 • Alessandro Achille, Glen Mbeng, Stefano Soatto

We compute the transition probability between two learning tasks, and show that it decomposes into two factors.

Semantic Textual Similarity Transfer Learning