AT-BERT: Adversarial Training BERT for Acronym Identification Winning Solution for SDU@AAAI-21

no code implementations • 11 Jan 2021 • Danqing Zhu, Wangli Lin, Yang Zhang, Qiwei Zhong, Guanxiong Zeng, Weilin Wu, Jiayu Tang

In this paper, we present an Adversarial Training BERT method named AT-BERT, our winning solution to acronym identification task for Scientific Document Understanding (SDU) Challenge of AAAI 2021.

document understanding Unsupervised Pre-training