Although parallel sentences rarely exist in quasi-comparable corpora, there could be parallel fragments that are also helpful for statistical machine translation (SMT). Previous studies cannot accurately extract parallel fragments from quasi-comparable corpora. To solve this problem, we propose an accurate parallel fragment extraction system that uses an alignment model to locate the parallel fragment candidates, and uses an accurate lexicon filter to identify the truly parallel ones. Experimental results indicate that our system can accurately extract parallel fragments, and our proposed method significantly outperforms a state-of-the-art approach. Furthermore, we investigate the factors that may affect the performance of our system in detail.
In quasi-comparable corpora, there are few or no parallel sentences REF .
Accurate Parallel Fragment Extraction from Quasi-Comparable Corpora using Alignment Model and Translation Lexicon
IJCNLP
Computer Science