Search Results for author:
Found 7 papers, 2 papers with code
PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs
Altogether, these results suggest that training on DP synthetic data can be a better option than training a model on-device on private distributed data.
On the Convergence of Differentially-Private Fine-tuning: To Linearly Probe or to Fully Fine-tune?
We provide theoretical insights into the convergence of DP fine-tuning within an overparameterized neural network and establish a utility curve that determines the allocation of privacy budget between linear probing and full fine-tuning.
Pretrained deep models outperform GBDTs in Learning-To-Rank under label scarcity
On tabular data, a significant body of literature has shown that current deep learning (DL) models perform at best similarly to Gradient Boosted Decision Trees (GBDTs), while significantly underperforming them on outlier data.
Privately Customizing Prefinetuning to Better Match User Data in Federated Learning
To this end, we propose FreD (Federated Private Fr\'echet Distance) -- a privately computed distance between a prefinetuning dataset and federated datasets.
FedChain: Chained Algorithms for Near-Optimal Communication Cost in Federated Learning
We propose FedChain, an algorithmic framework that combines the strengths of local methods and global methods to achieve fast convergence in terms of R while leveraging the similarity between clients.
Efficient Algorithms for Federated Saddle Point Optimization
Our goal is to design an algorithm that can harness the benefit of similarity in the clients while recovering the Minibatch Mirror-prox performance under arbitrary heterogeneity (up to log factors).
SquirRL: Automating Attack Discovery on Blockchain Incentive Mechanisms with Deep Reinforcement Learning
Incentive mechanisms are central to the functionality of permissionless blockchains: they incentivize participants to run and secure the underlying consensus protocol.
Cryptography and Security
