Linguistically-augmented perplexity-based data selection for language models ?
Word-level linguistic information for perplexity-based data selection. Evaluation and analysis for four languages: English, Spanish, Czech and Chinese. Combination of models lead to lower perplexity than the state-of-the-art baseline.
data selection language modelling computational linguistics