Search Results for author: Ossi Räisä

Found 3 papers, 1 papers with code

Subsampling is not Magic: Why Large Batch Sizes Work for Differentially Private Stochastic Optimisation

no code implementations6 Feb 2024 Ossi Räisä, Joonas Jälkö, Antti Honkela

The remaining subsampling-induced variance decreases with larger batch sizes, so large batches reduce the effective total gradient variance.

A Bias-Variance Decomposition for Ensembles over Multiple Synthetic Datasets

no code implementations6 Feb 2024 Ossi Räisä, Antti Honkela

We investigate how our theory works in practice by evaluating the performance of an ensemble over many synthetic datasets for several real datasets and downstream predictors.

Model Selection

Cannot find the paper you are looking for? You can Submit a new open access paper.