Determining the intended sense of words in text - word sense disambiguation (WSD) - is a long standing problem in natural language processing. Recently, researchers have shown promising results using word vectors extracted from a neural network language model as features in WSD algorithms... (read more)

PDFTask | Dataset | Model | Metric name | Metric value | Global rank | Compare |
---|---|---|---|---|---|---|

Word Sense Disambiguation | SemEval 2007 Task 17 | LSTMLP (T:SemCor, U:1K) | F1 | 63.5 | # 4 | |

Word Sense Disambiguation | SemEval 2007 Task 17 | LSTMLP (T:SemCor, U:OMSTI) | F1 | 63.7 | # 3 | |

Word Sense Disambiguation | SemEval 2007 Task 17 | LSTM (T:OMSTI) | F1 | 60.7 | # 6 | |

Word Sense Disambiguation | SemEval 2007 Task 17 | LSTM (T:SemCor) | F1 | 64.2 | # 2 | |

Word Sense Disambiguation | SemEval 2007 Task 17 | LSTMLP (T:OMSTI, U:1K) | F1 | 63.3 | # 5 | |

Word Sense Disambiguation | SemEval 2007 Task 7 | LSTMLP (T:OMSTI, U:1K) | F1 | 83.3 | # 4 | |

Word Sense Disambiguation | SemEval 2007 Task 7 | LSTMLP (T:SemCor, U:OMSTI) | F1 | 84.3 | # 2 | |

Word Sense Disambiguation | SemEval 2007 Task 7 | LSTM (T:OMSTI) | F1 | 81.1 | # 6 | |

Word Sense Disambiguation | SemEval 2007 Task 7 | LSTMLP (T:SemCor, U:1K) | F1 | 83.6 | # 3 | |

Word Sense Disambiguation | SemEval 2007 Task 7 | LSTM (T:SemCor) | F1 | 82.8 | # 5 | |

Word Sense Disambiguation | SemEval 2013 Task 12 | LSTMLP (T:OMSTI, U:1K) | F1 | 68.1 | # 3 | |

Word Sense Disambiguation | SemEval 2013 Task 12 | LSTM (T:OMSTI) | F1 | 67.3 | # 5 | |

Word Sense Disambiguation | SemEval 2013 Task 12 | LSTM (T:SemCor) | F1 | 67.0 | # 8 | |

Word Sense Disambiguation | SemEval 2013 Task 12 | LSTMLP (T:SemCor, U:OMSTI) | F1 | 67.9 | # 4 | |

Word Sense Disambiguation | SemEval 2013 Task 12 | LSTMLP (T:SemCor, U:1K) | F1 | 69.5 | # 2 | |

Word Sense Disambiguation | SensEval 2 | LSTMLP (T:OMSTI, U:1K) | F1 | 74.4 | # 2 | |

Word Sense Disambiguation | SensEval 2 | LSTM (T:SemCor) | F1 | 73.6 | # 5 | |

Word Sense Disambiguation | SensEval 2 | LSTM (T:OMSTI) | F1 | 72.4 | # 6 | |

Word Sense Disambiguation | SensEval 2 | LSTMLP (T:SemCor, U:OMSTI) | F1 | 73.9 | # 3 | |

Word Sense Disambiguation | SensEval 2 | LSTMLP (T:SemCor, U:1K) | F1 | 73.8 | # 4 | |

Word Sense Disambiguation | SensEval 3 Task 1 | LSTM (T:SemCor) | F1 | 69.2 | # 9 | |

Word Sense Disambiguation | SensEval 3 Task 1 | LSTM (T:OMSTI) | F1 | 64.3 | # 10 | |

Word Sense Disambiguation | SensEval 3 Task 1 | LSTMLP (T:SemCor, U:OMSTI) | F1 | 71.1 | # 2 | |

Word Sense Disambiguation | SensEval 3 Task 1 | LSTMLP (T:SemCor, U:1K) | F1 | 71.8 | # 1 | |

Word Sense Disambiguation | SensEval 3 Task 1 | LSTMLP (T:OMSTI, U:1K) | F1 | 71.0 | # 3 |