Near Human-Level Performance in Grammatical Error Correction with Hybrid Machine Translation

We combine two of the most popular approaches to automated Grammatical Error Correction (GEC): GEC based on Statistical Machine Translation (SMT) and GEC based on Neural Machine Translation (NMT). The hybrid system achieves new state-of-the-art results on the CoNLL-2014 and JFLEG benchmarks. This GEC system preserves the accuracy of SMT output and, at the same time, generates more fluent sentences as it typical for NMT. Our analysis shows that the created systems are closer to reaching human-level performance than any other GEC system reported so far.

PDF Abstract NAACL 2018 PDF NAACL 2018 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Grammatical Error Correction CoNLL-2014 Shared Task SMT + BiGRU F0.5 56.25 # 20
Grammatical Error Correction CoNLL-2014 Shared Task (10 annotations) SMT + BiGRU F0.5 72.04 # 2
Grammatical Error Correction JFLEG SMT + BiGRU GLEU 61.5 # 3

Methods


No methods listed for this paper. Add relevant methods here