Update added_tokens.json
Browse files- added_tokens.json +1 -0
added_tokens.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"<BOS>": 50257, "<EOS>": 50258, "<PAD>": 50259}
|