Domain-Agnostic Clustering with Self-Distillation

no code implementations • 23 Nov 2021 • Mohammed Adnan, Yani A. Ioannou, Chuan-Yung Tsai, Graham W. Taylor

Recent advancements in self-supervised learning have reduced the gap between supervised and unsupervised representation learning.

Clustering Data Augmentation +4

Gradient Flow in Sparse Neural Networks and How Lottery Tickets Win

1 code implementation • 7 Oct 2020 • Utku Evci, Yani A. Ioannou, Cem Keskin, Yann Dauphin

Sparse Neural Networks (NNs) can match the generalization of dense NNs using a fraction of the compute/storage for inference, and also have the potential to enable efficient training.