File size: 326 Bytes
6321586 09b3002 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
---
license: mit
datasets:
- wikipedia
- oscar
language:
- ja
- ko
tags:
- kenlm
- perplexity
- n-gram
- kneser-ney
- bigscience
---
# KenLM models
This repo is a copy of [edugp/kenlm](https://huggingface.co/edugp/kenlm) but for the Japanese and Korean languages.
The Wikipedia models were trained using the `20231106` dump. |