Leveraging Domain Agnostic and Specific Knowledge for Acronym Disambiguation

no code implementations • 1 Jul 2021 • Qiwei Zhong, Guanxiong Zeng, Danqing Zhu, Yang Zhang, Wangli Lin, Ben Chen, Jiayu Tang

In this paper, we consider both the domain agnostic and specific knowledge, and propose a Hierarchical Dual-path BERT method coined hdBERT to capture the general fine-grained and high-level specific representations for acronym disambiguation.

document understanding Word Embeddings

AT-BERT: Adversarial Training BERT for Acronym Identification Winning Solution for SDU@AAAI-21

no code implementations • 11 Jan 2021 • Danqing Zhu, Wangli Lin, Yang Zhang, Qiwei Zhong, Guanxiong Zeng, Weilin Wu, Jiayu Tang

In this paper, we present an Adversarial Training BERT method named AT-BERT, our winning solution to acronym identification task for Scientific Document Understanding (SDU) Challenge of AAAI 2021.

document understanding Unsupervised Pre-training