Add test for corpus-based tokenization.