Update added_tokens.json
Browse files- added_tokens.json +1 -0
added_tokens.json
ADDED
@@ -0,0 +1 @@
|
|
|
1 |
+
{"<WP>": 50257, "<endoftext>": 50258, "<PAD>": 50259, "<endprompt>": 50260, "<newline>": 50261}
|