Search Results for author: Lun Wang

Found 16 papers, 4 papers with code

Noise Masking Attacks and Defenses for Pretrained Speech Models

no code implementations2 Apr 2024 Matthew Jagielski, Om Thakkar, Lun Wang

Our method fine-tunes the encoder to produce an ASR model, and then performs noise masking on this model, which we find recovers private information from the pretraining data, despite the model never having seen transcripts at pretraining time!

Automatic Speech Recognition Automatic Speech Recognition (ASR) +1

RareBench: Can LLMs Serve as Rare Diseases Specialists?

1 code implementation9 Feb 2024 Xuanzhong Chen, Xiaohao Mao, Qihan Guo, Lun Wang, Shuyang Zhang, Ting Chen

Meanwhile, we have compiled the largest open-source dataset on rare disease patients, establishing a benchmark for future studies in this domain.

Medical Diagnosis

MergeSFL: Split Federated Learning with Feature Merging and Batch Size Regulation

no code implementations22 Nov 2023 Yunming Liao, Yang Xu, Hongli Xu, Lun Wang, Zhiwei Yao, Chunming Qiao

Recently, federated learning (FL) has emerged as a popular technique for edge AI to mine valuable knowledge in edge computing (EC) systems.

Edge-computing Federated Learning

Unintended Memorization in Large ASR Models, and How to Mitigate It

no code implementations18 Oct 2023 Lun Wang, Om Thakkar, Rajiv Mathews

We empirically show that clipping each example's gradient can mitigate memorization for sped-up training examples with up to 16 repetitions in the training set.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +2

Why Is Public Pretraining Necessary for Private Model Training?

no code implementations19 Feb 2023 Arun Ganesh, Mahdi Haghifam, Milad Nasr, Sewoong Oh, Thomas Steinke, Om Thakkar, Abhradeep Thakurta, Lun Wang

To explain this phenomenon, we hypothesize that the non-convex loss landscape of a model training necessitates an optimization algorithm to go through two phases.

Transfer Learning

Byzantine-Robust Federated Learning with Optimal Statistical Rates and Privacy Guarantees

2 code implementations24 May 2022 Banghua Zhu, Lun Wang, Qi Pang, Shuai Wang, Jiantao Jiao, Dawn Song, Michael I. Jordan

In contrast to prior work, our proposed protocols improve the dimension dependence and achieve a tight statistical rate in terms of all the parameters for strongly convex losses.

Federated Learning

Secure Byzantine-Robust Federated Learning with Dimension-free Error

no code implementations29 Sep 2021 Lun Wang, Qi Pang, Shuai Wang, Dawn Song

In the present work, we propose a federated learning protocol with bi-directional security guarantees.

Federated Learning

FED-$\chi^2$: Secure Federated Correlation Test

no code implementations29 Sep 2021 Lun Wang, Qi Pang, Shuai Wang, Dawn Song

In this paper, we propose the first secure federated $\chi^2$-test protocol, FED-$\chi^2$.

BACKDOORL: Backdoor Attack against Competitive Reinforcement Learning

no code implementations2 May 2021 Lun Wang, Zaynah Javed, Xian Wu, Wenbo Guo, Xinyu Xing, Dawn Song

Recent research has confirmed the feasibility of backdoor attacks in deep reinforcement learning (RL) systems.

Atari Games Backdoor Attack +2

F^2ed-Learning: Good Fences Make Good Neighbors

no code implementations1 Jan 2021 Lun Wang, Qi Pang, Shuai Wang, Dawn Song

In this paper, we present F^2ed-Learning, the first federated learning protocol simultaneously defending against both semi-honest server and Byzantine malicious clients.

Federated Learning

D2p-fed:Differentially Private Federated Learning with Efficient Communication

no code implementations1 Jan 2021 Lun Wang, Ruoxi Jia, Dawn Song

We provide complete analysis of the privacy guarantee, communication cost and convergence rate of D2p-fed.

Federated Learning

Towards Bidirectional Protection in Federated Learning

no code implementations2 Oct 2020 Lun Wang, Qi Pang, Shuai Wang, Dawn Song

At one end of the spectrum, some work uses secure aggregation techniques to hide the individual client's updates and only reveal the aggregated global update to a malicious server that strives to infer the clients' privacy from their updates.

Federated Learning

D2P-Fed: Differentially Private Federated Learning With Efficient Communication

no code implementations22 Jun 2020 Lun Wang, Ruoxi Jia, Dawn Song

In this paper, we propose the discrete Gaussian based differentially private federated learning (D2P-Fed), a unified scheme to achieve both differential privacy (DP) and communication efficiency in federated learning (FL).

Federated Learning

Towards practical differentially private causal graph discovery

no code implementations NeurIPS 2020 Lun Wang, Qi Pang, Dawn Song

Causal graph discovery refers to the process of discovering causal relation graphs from purely observational data.

TABOR: A Highly Accurate Approach to Inspecting and Restoring Trojan Backdoors in AI Systems

1 code implementation2 Aug 2019 Wenbo Guo, Lun Wang, Xinyu Xing, Min Du, Dawn Song

As such, given a deep neural network model and clean input samples, it is very challenging to inspect and determine the existence of a trojan backdoor.

Anomaly Detection

Cannot find the paper you are looking for? You can Submit a new open access paper.