Provable Benefits of Unsupervised Pre-training and Transfer Learning via Single-Index Models

no code implementations • 24 Feb 2025 • Taj Jones-McCormick, Aukosh Jagannath, Subhabrata Sen

Unsupervised pre-training and transfer learning are commonly used techniques to initialize training algorithms for neural networks, particularly in settings with limited labeled data.

Transfer Learning Unsupervised Pre-training