rsmonteiro
commited on
Commit
•
69f7223
1
Parent(s):
27dd790
Upload added_tokens.json
Browse files- added_tokens.json +1 -0
added_tokens.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"<|BOS|>": 50257, "<|EOS|>": 50258, "<|SEP|>": 50261, "<|PAD|>": 50260, "<|UNK|>": 50259}
|