generate_nft_content / added_tokens.json
jcarbonnell's picture
add tokenizer
0ca2566
{"<|startoftext|>": 50257, "<|pad|>": 50258}