SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing

3 code implementations • EMNLP 2018 • Taku Kudo, John Richardson

We perform a validation experiment of NMT on English-Japanese machine translation, and find that it is possible to achieve comparable accuracy to direct subword training from raw sentences.

Machine Translation NMT +2

Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates

2 code implementations • ACL 2018 • Taku Kudo

Subword units are an effective way to alleviate the open vocabulary problems in neural machine translation (NMT).

Language Modelling Machine Translation +3

Phrase-based Machine Translation using Multiple Preordering Candidates

no code implementations • COLING 2016 • Yusuke Oda, Taku Kudo, Tetsuji Nakagawa, Taro Watanabe

In this paper, we propose a new decoding method for phrase-based statistical machine translation which directly uses multiple preordering candidates as a graph structure.

Machine Translation Translation

Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation

28 code implementations • 26 Sep 2016 • Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, Jeff Klingner, Apurva Shah, Melvin Johnson, Xiaobing Liu, Łukasz Kaiser, Stephan Gouws, Yoshikiyo Kato, Taku Kudo, Hideto Kazawa, Keith Stevens, George Kurian, Nishant Patil, Wei Wang, Cliff Young, Jason Smith, Jason Riesa, Alex Rudnick, Oriol Vinyals, Greg Corrado, Macduff Hughes, Jeffrey Dean

To improve parallelism and therefore decrease training time, our attention mechanism connects the bottom layer of the decoder to the top layer of the encoder.

Machine Translation NMT +2

A joint inference of deep case analysis and zero subject generation for Japanese-to-English statistical machine translation

no code implementations • ACL 2014 • Taku Kudo, Hiroshi Ichikawa, Hideto Kazawa

Machine Translation Translation