Search Results for author: Daniel Cheung

Found 2 papers, 0 papers with code

Lex-BERT: Enhancing BERT based NER with lexicons

no code implementations2 Jan 2021 Wei Zhu, Daniel Cheung

In this work, we represent Lex-BERT, which incorporates the lexicon information into Chinese BERT for named entity recognition (NER) tasks in a natural manner.

named-entity-recognition Named Entity Recognition +3

CMV-BERT: Contrastive multi-vocab pretraining of BERT

no code implementations29 Dec 2020 Wei Zhu, Daniel Cheung

In this work, we represent CMV-BERT, which improves the pretraining of a language model via two ingredients: (a) contrastive learning, which is well studied in the area of computer vision; (b) multiple vocabularies, one of which is fine-grained and the other is coarse-grained.

Contrastive Learning Language Modelling +1

Cannot find the paper you are looking for? You can Submit a new open access paper.