Before revision: Grammatical error correction (GEC) literature has reported on the effectiveness of pretraining a Seq2Seq model with a large amount of pseudo data.
After revision: Grammatical error correction (GEC) have reported the effectiveness of pretraining a Seq2Seq model with a large amount of pseudo data.