copywriting-generator-ver50k / added_tokens.json
diamantrsd's picture
Upload tokenizer
d21401f
{
"<|EOS|>": 50257,
"<|pad|>": 50258
}