Scalable Collaborative Learning via Representation Sharing

no code implementations • 20 Nov 2022 • Frédéric Berdoz, Abhishek Singh, Martin Jaggi, Ramesh Raskar

To do so, each client releases averaged last hidden layer activations of similar labels to a central server that only acts as a relay (i. e., is not involved in the training or aggregation of the models).

Federated Learning Knowledge Distillation +1