May I add korean?

#2
by seopbo - opened

May I add below assets for korean?

  • kenlm/wikipedia/ko.arpa.bin
  • kenlm/wikipedia/ko.sp.model
  • kenlm/wikipedia/ko.sp.vocab

You can modify the following script to train your own model for Korean: https://github.com/bigscience-workshop/data_tooling/blob/master/kenlm_training/train_all.sh

Sign up or log in to comment