openelm-ct / added_tokens.json
TinyPixel's picture
Upload tokenizer
b5882e5 verified
raw
history blame
113 Bytes
{
"<|assistant|>": 32002,
"<|end|>": 32003,
"<|pad|>": 32004,
"<|system|>": 32001,
"<|user|>": 32000
}