russian_alternative_indi / added_tokens.json
Milana's picture
Upload tokenizer
4715d9c
raw
history blame contribute delete
No virus
191 Bytes
{
"<|endoftext|>": 50257,
"[PAD]": 50264,
"[e:artist]": 50261,
"[e:lyrics]": 50263,
"[e:song_name]": 50262,
"[s:artist]": 50258,
"[s:lyrics]": 50260,
"[s:song_name]": 50259
}