CopyMTL: Copy Mechanism for Joint Extraction of Entities and Relations with Multi-Task Learning

24 Nov 2019  ·  Daojian Zeng, Ranran Haoran Zhang, Qianying Liu ·

Joint extraction of entities and relations has received significant attention due to its potential of providing higher performance for both tasks. Among existing methods, CopyRE is effective and novel, which uses a sequence-to-sequence framework and copy mechanism to directly generate the relation triplets. However, it suffers from two fatal problems. The model is extremely weak at differing the head and tail entity, resulting in inaccurate entity extraction. It also cannot predict multi-token entities (e.g. \textit{Steven Jobs}). To address these problems, we give a detailed analysis of the reasons behind the inaccurate entity extraction problem, and then propose a simple but extremely effective model structure to solve this problem. In addition, we propose a multi-task learning framework equipped with copy mechanism, called CopyMTL, to allow the model to predict multi-token entities. Experiments reveal the problems of CopyRE and show that our model achieves significant improvement over the current state-of-the-art method by 9% in NYT and 16% in WebNLG (F1 score). Our code is available at

PDF Abstract


Results from the Paper

Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Relation Extraction NYT CopyRE' OneDecoder F1 72.2 # 16
Relation Extraction WebNLG CopyRE' OneDecoder F1 60.5 # 11


No methods listed for this paper. Add relevant methods here