audiocaps-simple-tokenizer / special_tokens_map.json
wsntxxn's picture
Upload tokenizer
b36622f verified
raw
history blame
142 Bytes
{
"additional_special_tokens": [
"<start>",
"<end>"
],
"bos_token": "<start>",
"eos_token": "<end>",
"unk_token": "<unk>"
}