precious3-gpt / special_tokens_map.json
stefan-insilico's picture
Upload 2 files
be88fc5 verified
raw
history blame
188 Bytes
{
"additional_special_tokens": [
"[UNK]",
"[PAD]",
"[EOS]",
"[BOS]"
],
"bos_token": "[BOS]",
"eos_token": "[EOS]",
"pad_token": "[PAD]",
"unk_token": "[UNK]"
}