Incorporating Glosses into Neural Word Sense Disambiguation

Word Sense Disambiguation (WSD) aims to identify the correct meaning of polysemous words in the particular context. Lexical resources like WordNet which are proved to be of great help for WSD in the knowledge-based methods. However, previous neural networks for WSD always rely on massive labeled data (context), ignoring lexical resources like glosses (sense definitions). In this paper, we integrate the context and glosses of the target word into a unified framework in order to make full use of both labeled data and lexical knowledge. Therefore, we propose GAS: a gloss-augmented WSD neural network which jointly encodes the context and glosses of the target word. GAS models the semantic relationship between the context and the gloss in an improved memory network framework, which breaks the barriers of the previous supervised methods and knowledge-based methods. We further extend the original gloss of word sense via its semantic relations in WordNet to enrich the gloss information. The experimental results show that our model outperforms the state-of-theart systems on several English all-words WSD datasets.

PDF Abstract ACL 2018 PDF ACL 2018 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Word Sense Disambiguation SemEval 2013 Task 12 GASext (Linear) F1 67.1 # 8
Word Sense Disambiguation SemEval 2013 Task 12 GAS (Concatenation) F1 67.0 # 9
Word Sense Disambiguation SemEval 2013 Task 12 GAS (Linear) F1 66.7 # 11
Word Sense Disambiguation SemEval 2013 Task 12 GASext (Concatenation) F1 67.2 # 7
Word Sense Disambiguation SemEval 2015 Task 13 GAS (Linear) F1 71.6 # 6
Word Sense Disambiguation SemEval 2015 Task 13 GASext (Linear) F1 72.1 # 4
Word Sense Disambiguation SemEval 2015 Task 13 GAS (Concatenation) F1 71.8 # 5
Word Sense Disambiguation SemEval 2015 Task 13 GASext (Concatenation) F1 72.6 # 3
Word Sense Disambiguation SensEval 2 GASext (Concatenation) F1 72.2 # 9
Word Sense Disambiguation SensEval 2 GAS (Linear) F1 72.0 # 11
Word Sense Disambiguation SensEval 2 GAS (Concatenation) F1 72.1 # 10
Word Sense Disambiguation SensEval 2 GASext (Linear) F1 72.4 # 7
Word Sense Disambiguation SensEval 3 Task 1 GASext (Linear) F1 70.1 # 8
Word Sense Disambiguation SensEval 3 Task 1 GAS (Concatenation) F1 70.2 # 6
Word Sense Disambiguation SensEval 3 Task 1 GASext (Concatenation) F1 70.5 # 5
Word Sense Disambiguation SensEval 3 Task 1 GAS (Linear) F1 70.0 # 9
Word Sense Disambiguation Supervised: GAS Senseval 2 72.0 # 19
Senseval 3 70.0 # 19
SemEval 2007 --* # 22
SemEval 2013 66.7 # 20
SemEval 2015 71.6 # 21
Word Sense Disambiguation Supervised: GAS<sub>ext</sub> Senseval 2 72.2 # 18
Senseval 3 70.5 # 17
SemEval 2007 --* # 22
SemEval 2013 67.2 # 17
SemEval 2015 72.6 # 17

Methods


No methods listed for this paper. Add relevant methods here