LongAlpaca_70_EurlexIta_8k / added_tokens.json
gianma's picture
Upload tokenizer
ba5dddd
raw
history blame contribute delete
60 Bytes
{
"</s>": 2,
"<s>": 1,
"<unk>": 0,
"[PAD]": 32000
}