opt-125m-endpoint-detector-2 / added_tokens.json
jeradf's picture
Upload tokenizer
7c65f1a verified
raw
history blame contribute delete
98 Bytes
{
"<|assistant|>": 50268,
"<|im_end|>": 50266,
"<|im_start|>": 50265,
"<|user|>": 50267
}