orofido commited on
Commit
da2e8df
1 Parent(s): 7031bc1

Update README.md

Browse files

The tokenizer is trained using sentencepiece similarly to llama3 tokenizer configuration.

Files changed (1) hide show
  1. README.md +6 -3
README.md CHANGED
@@ -1,3 +1,6 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - km
5
+ - en
6
+ ---