Artificial Error Generation with Machine Translation and Syntactic Patterns

WS 2017  ·  Marek Rei, Mariano Felice, Zheng Yuan, Ted Briscoe ·

Shortage of available training data is holding back progress in the area of automated error detection. This paper investigates two alternative methods for artificially generating writing errors, in order to create additional resources. We propose treating error generation as a machine translation task, where grammatically correct text is translated to contain errors. In addition, we explore a system for extracting textual patterns from an annotated corpus, which can then be used to insert errors into grammatically correct sentences. Our experiments show that the inclusion of artificially generated errors significantly improves error detection accuracy on both FCE and CoNLL 2014 datasets.

PDF Abstract WS 2017 PDF WS 2017 Abstract

Datasets


Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Grammatical Error Detection CoNLL-2014 A1 Ann+PAT+MT F0.5 21.87 # 5
Grammatical Error Detection CoNLL-2014 A2 Ann+PAT+MT F0.5 30.13 # 4
Grammatical Error Detection FCE Ann+PAT+MT F0.5 49.11 # 3

Methods


No methods listed for this paper. Add relevant methods here