Gradient Broadcast Adaptation: Defending against the backdoor attack in pre-trained models

no code implementations • 29 Sep 2021 • Tianyu Chen, Haoyi Zhou, He Mingrui, JianXin Li

Pre-trained language models (e. g, BERT, GPT-3) have revolutionized the NLP research and fine-tuning becomes the indispensable step of downstream adaptation.

Backdoor Attack text-classification +1