Ralphch97's picture
Upload tokenizer
938b015
raw
history blame contribute delete
93 Bytes
{
"<|assistant|>": 49154,
"<|end|>": 49155,
"<|system|>": 49152,
"<|user|>": 49153
}