vigogne-2-7b-Junia / added_tokens.json
Maxime62's picture
Upload tokenizer
5ed2793 verified
raw
history blame contribute delete
88 Bytes
{
"<pad>": 32000,
"HEI": 32003,
"ISA": 32002,
"ISEN": 32001,
"JUNIA": 32004
}