versae commited on
Commit
5230060
1 Parent(s): d0ebda9

SentencePiece byte fallback 32k

Browse files
Files changed (2) hide show
  1. sentencepiece.model +3 -0
  2. sentencepiece.vocab +0 -0
sentencepiece.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43fe9f6873b1e19fb09df7d7ee9ab5f4ccef55ba845c94f8613ed705c6c769e3
3
+ size 770466
sentencepiece.vocab ADDED
The diff for this file is too large to render. See raw diff