CodeLlama-34b-hf_4bit_bnb / added_tokens.json
Zangs3011's picture
Upload tokenizer
f4b4903 verified
raw
history blame contribute delete
No virus
87 Bytes
{
"▁<EOT>": 32003,
"▁<MID>": 32001,
"▁<PRE>": 32000,
"▁<SUF>": 32002
}