Update added_tokens.json
Browse files- added_tokens.json +1 -0
added_tokens.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"<BOS>": 50257, "<EOS>": 50258, "<PAD>": 50259, "<drama>": 50260, "<action>": 50261, "<horror>": 50262, "<thriller>": 50263, "<sci_fi>": 50264, "<superhero>": 50265}
|