JerrySiRi commited on
Commit
9108cec
1 Parent(s): 6117112

Upload tokenizer

Browse files
Files changed (3) hide show
  1. added_tokens.json +0 -0
  2. tokenizer.json +2 -2
  3. tokenizer_config.json +0 -0
added_tokens.json CHANGED
The diff for this file is too large to render. See raw diff
 
tokenizer.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1266e0edc0bc19b131866b403edb3cc5db56f83199c2348c5bfb661b24275554
3
- size 10522807
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1e9f7c16f2a8b3c693dfc4519d81273921f0e79ce5ce3fd1f95fdb357c72a62
3
+ size 10399999
tokenizer_config.json CHANGED
The diff for this file is too large to render. See raw diff