The University of Sydney's Machine Translation System for WMT19

This paper describes the University of Sydney's submission of the WMT 2019 shared news translation task. We participated in the Finnish$\rightarrow$English direction and got the best BLEU(33.0) score among all the participants... (read more)

PDF Abstract WS 2019 PDF WS 2019 Abstract
No code implementations yet. Submit your code now
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT BENCHMARK
Machine Translation WMT2016 Finnish-English CT+B/S construction BLEU 32.4 # 1
Machine Translation WMT2017 Finnish-English CT+B/S construction BLEU 35.5 # 1
Machine Translation WMT 2018 Finnish-English CT+B/S construction BLEU 26.5 # 1
Machine Translation WMT2019 Finnish-English CT+B/S construction BLEU 34.1 # 1

Methods used in the Paper


METHOD TYPE
Residual Connection
Skip Connections
BPE
Subword Segmentation
Dense Connections
Feedforward Networks
Label Smoothing
Regularization
ReLU
Activation Functions
Adam
Stochastic Optimization
Softmax
Output Functions
Dropout
Regularization
Multi-Head Attention
Attention Modules
Layer Normalization
Normalization
Scaled Dot-Product Attention
Attention Mechanisms
Transformer
Transformers