We present a word alignment framework that can incorporate partial manual alignments. The core of the approach is a novel semi-supervised algorithm extending the widely used IBM Models with a constrained EM algorithm. The partial manual alignments can be obtained by human labelling or automatically by high-precision-low-recall heuristics. We demonstrate the usages of both methods by selecting alignment links from manually aligned corpus and apply links generated from bilingual dictionary on unlabelled data. For the first method, we conduct controlled experiments on ChineseEnglish and Arabic-English translation tasks to compare the quality of word alignment, and to measure effects of two different methods in selecting alignment links from manually aligned corpus. For the second method, we experimented with moderate-scale Chinese-English translation task. The experiment results show an average improvement of 0.33 BLEU point across 8 test sets.
REF present a semi-supervised algorithm that extends IBM Model 4 by using partial manual alignments.
A Semi-Supervised Word Alignment Algorithm with Partial Manual Alignments
Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR
Computer Science