model / added_tokens.json
ham19za's picture
add tokenizer
2183b8f
{"<|startoftext|>": 50257, "<|pad|>": 50258}