clvp_dev / added_tokens.json
susnato's picture
Uploaded new saved tokenizer
75a9688
raw
history blame contribute delete
No virus
72 Bytes
{
"<|endoftext|>": 255,
"[SPACE]": 2,
"[STOP]": 0,
"[UNK]": 1
}