Semi-supervised Word Sense Disambiguation with Neural Models

COLING 2016 Dayu YuanJulian RichardsonRyan DohertyColin EvansEric Altendorf

Determining the intended sense of words in text - word sense disambiguation (WSD) - is a long standing problem in natural language processing. Recently, researchers have shown promising results using word vectors extracted from a neural network language model as features in WSD algorithms... (read more)

PDF Abstract

Evaluation results from the paper


Task Dataset Model Metric name Metric value Global rank Compare
Word Sense Disambiguation SemEval 2007 Task 17 LSTMLP (T:SemCor, U:1K) F1 63.5 # 4
Word Sense Disambiguation SemEval 2007 Task 17 LSTMLP (T:SemCor, U:OMSTI) F1 63.7 # 3
Word Sense Disambiguation SemEval 2007 Task 17 LSTM (T:OMSTI) F1 60.7 # 6
Word Sense Disambiguation SemEval 2007 Task 17 LSTM (T:SemCor) F1 64.2 # 2
Word Sense Disambiguation SemEval 2007 Task 17 LSTMLP (T:OMSTI, U:1K) F1 63.3 # 5
Word Sense Disambiguation SemEval 2007 Task 7 LSTMLP (T:OMSTI, U:1K) F1 83.3 # 4
Word Sense Disambiguation SemEval 2007 Task 7 LSTMLP (T:SemCor, U:OMSTI) F1 84.3 # 2
Word Sense Disambiguation SemEval 2007 Task 7 LSTM (T:OMSTI) F1 81.1 # 6
Word Sense Disambiguation SemEval 2007 Task 7 LSTMLP (T:SemCor, U:1K) F1 83.6 # 3
Word Sense Disambiguation SemEval 2007 Task 7 LSTM (T:SemCor) F1 82.8 # 5
Word Sense Disambiguation SemEval 2013 Task 12 LSTMLP (T:OMSTI, U:1K) F1 68.1 # 3
Word Sense Disambiguation SemEval 2013 Task 12 LSTM (T:OMSTI) F1 67.3 # 5
Word Sense Disambiguation SemEval 2013 Task 12 LSTM (T:SemCor) F1 67.0 # 8
Word Sense Disambiguation SemEval 2013 Task 12 LSTMLP (T:SemCor, U:OMSTI) F1 67.9 # 4
Word Sense Disambiguation SemEval 2013 Task 12 LSTMLP (T:SemCor, U:1K) F1 69.5 # 2
Word Sense Disambiguation SensEval 2 LSTMLP (T:OMSTI, U:1K) F1 74.4 # 2
Word Sense Disambiguation SensEval 2 LSTM (T:SemCor) F1 73.6 # 5
Word Sense Disambiguation SensEval 2 LSTM (T:OMSTI) F1 72.4 # 6
Word Sense Disambiguation SensEval 2 LSTMLP (T:SemCor, U:OMSTI) F1 73.9 # 3
Word Sense Disambiguation SensEval 2 LSTMLP (T:SemCor, U:1K) F1 73.8 # 4
Word Sense Disambiguation SensEval 3 Task 1 LSTM (T:SemCor) F1 69.2 # 9
Word Sense Disambiguation SensEval 3 Task 1 LSTM (T:OMSTI) F1 64.3 # 10
Word Sense Disambiguation SensEval 3 Task 1 LSTMLP (T:SemCor, U:OMSTI) F1 71.1 # 2
Word Sense Disambiguation SensEval 3 Task 1 LSTMLP (T:SemCor, U:1K) F1 71.8 # 1
Word Sense Disambiguation SensEval 3 Task 1 LSTMLP (T:OMSTI, U:1K) F1 71.0 # 3