UmlsBERT: Clinical Domain Knowledge Augmentation of Contextual Embeddings Using the Unified Medical Language System Metathesaurus

1 code implementation • NAACL 2021 • George Michalopoulos, Yuanxin Wang, Hussam Kaka, Helen Chen, Alexander Wong

Contextual word embedding models, such as BioBERT and Bio_ClinicalBERT, have achieved state-of-the-art results in biomedical natural language processing tasks by focusing their pre-training process on domain-specific corpora.

named-entity-recognition Named Entity Recognition +3