Named entity recognition architecture combining contextual and global features

15 Dec 2021  ·  Tran Thi Hong Hanh, Antoine Doucet, Nicolas Sidere, Jose G. Moreno, Senja Pollak ·

Named entity recognition (NER) is an information extraction technique that aims to locate and classify named entities (e.g., organizations, locations,...) within a document into predefined categories. Correctly identifying these phrases plays a significant role in simplifying information access. However, it remains a difficult task because named entities (NEs) have multiple forms and they are context-dependent. While the context can be represented by contextual features, global relations are often misrepresented by those models. In this paper, we propose the combination of contextual features from XLNet and global features from Graph Convolution Network (GCN) to enhance NER performance. Experiments over a widely-used dataset, CoNLL 2003, show the benefits of our strategy, with results competitive with the state of the art (SOTA).

PDF Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Named Entity Recognition (NER) CoNLL 2003 (English) XLNet-GCN F1 93.82 # 8
Named Entity Recognition (NER) CoNLL 2003 (English) GCN F1 88.63 # 70
Named Entity Recognition (NER) CoNLL 2003 (English) XLNet F1 93.28 # 24

Methods