Search Results for author: Rogier Van Dalen

Found 10 papers, 2 papers with code

Enforcing fairness in private federated learning via the modified method of differential multipliers

no code implementations17 Sep 2021 Borja Rodríguez-Gálvez, Filip Granqvist, Rogier Van Dalen, Matt Seigel

This paper introduces an algorithm to enforce group fairness in private federated learning, where users' data does not leave their devices.

BIG-bench Machine Learning Fairness +1

Training a Tokenizer for Free with Private Federated Learning

no code implementations15 Mar 2022 Eugene Bagdasaryan, Congzheng Song, Rogier Van Dalen, Matt Seigel, Áine Cahill

During private federated learning of the language model, we sample from the model, train a new tokenizer on the sampled sequences, and update the model embeddings.

Federated Learning Language Modelling

SummaryMixing: A Linear-Complexity Alternative to Self-Attention for Speech Recognition and Understanding

1 code implementation12 Jul 2023 Titouan Parcollet, Rogier Van Dalen, Shucong Zhang, Sourav Bhattacharya

Unfortunately, token mixing with self-attention takes quadratic time in the length of the speech utterance, slowing down inference as well as training and increasing memory consumption.

speech-recognition Speech Recognition

Globally Normalising the Transducer for Streaming Speech Recognition

no code implementations20 Jul 2023 Rogier Van Dalen

Instead, this paper proposes to approximate the loss function, allowing global normalisation to apply to a state-of-the-art streaming model.

speech-recognition Speech Recognition

pfl-research: simulation framework for accelerating research in Private Federated Learning

1 code implementation9 Apr 2024 Filip Granqvist, Congzheng Song, Áine Cahill, Rogier Van Dalen, Martin Pelikan, Yi Sheng Chan, Xiaojun Feng, Natarajan Krishnaswami, Vojta Jina, Mona Chitnis

Federated learning (FL) is an emerging machine learning (ML) training paradigm where clients own their data and collaborate to train a global model, without revealing any data to the server and other participants.

Federated Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.