model / added_tokens.json
ham19za's picture
add tokenizer
2183b8f
raw
history blame contribute delete
No virus
44 Bytes
{"<|startoftext|>": 50257, "<|pad|>": 50258}