v62_Large_2E / added_tokens.json
jppaolim's picture
add tokenizer
d4d5a94
raw
history blame
125 Bytes
{"<|Title|>": 50257, "<|Step 4|>": 50261, "<|Step 2|>": 50259, "<|Step 3|>": 50260, "<|Step 5|>": 50262, "<|Step 1|>": 50258}