daulet25 commited on
Commit
bf68e56
1 Parent(s): 2e1144a

update command tokenizer to match latest release

Browse files
Files changed (2) hide show
  1. README.md +2 -2
  2. tokenizer.json +2 -2
README.md CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e9074f17c5a9859ce432979f0ed72b102369fe0b1e211f99381a41ab068e971b
3
- size 709
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8d84577259b158f02ef147d8780ea9705088abf4edcdf8d020b919d83418e01
3
+ size 701
tokenizer.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9ab4b92b36d34ef721489d21e41aa6ab08362d2bd3e34faf4e64ed48358f0794
3
- size 3024310
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2a15f7b2a2f647bb4b288e1b2faeb7b7e7afe55acf014cb266ca44f3c29af9a
3
+ size 3163464