Changed the schema for the tokenizer.bin files, so overwriting with the new format
Browse files- stories260K/tok512.bin +2 -2
stories260K/tok512.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:037cb335abb25d1fa9e8ecae30ed2a3a8ace9302862ebcdc05d51a6bbb10c312
|
3 |
+
size 6227
|