PixelLLM / added_tokens.json
higgsfield's picture
Upload tokenizer
7699e9d
raw
history blame contribute delete
62 Bytes
{
"</s>": 2,
"<s>": 1,
"<unk>": 0,
"<|pad|>": 32000
}