stefan-it commited on
Commit
228ce67
1 Parent(s): 084a9e0

tokenizer: add original SPM model

Browse files
Files changed (1) hide show
  1. spiece.model +3 -0
spiece.model ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2dffd01fc009b7e92d98eddff8853983e271b41302ed0d363000e8581df12000
3
+ size 817200