Sequence-to-Sequence Learning as Beam-Search Optimization

EMNLP 2016 Sam WisemanAlexander M. Rush

Sequence-to-Sequence (seq2seq) modeling has rapidly become an important general-purpose NLP tool that has proven effective for many text-generation and sequence-labeling tasks. Seq2seq builds on deep neural language modeling and inherits its remarkable accuracy in estimating local, next-word distributions... (read more)

PDF Abstract

Evaluation Results from the Paper


TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK COMPARE
Machine Translation IWSLT2015 German-English Word-level CNN w/attn, input feeding BLEU score 24.0 # 17