cl100k_base / added_tokens.json
gugarosa's picture
Update added_tokens.json
72b2fe4
raw
history blame contribute delete
143 Bytes
{
"<|endoftext|>": 100257,
"<|fim_prefix|>": 100258,
"<|fim_middle|>": 100259,
"<|fim_suffix|>": 100260,
"<|endofprompt|>": 100276
}