Before revision:  With pre-training on large-scale data and cycle-consistent sentence embedding, our extended sentence-level model can achieve comparable detection accuracy to the token-level model. As a by-product, such a strategy enables simultaneous incoherence detection and infilling/modification suggestions .
After revision:  With pre-training on large-scale data and auxiliary sentence prediction training objective further boost the detection performance of the sentence-level model .