xlsr_hindi_LMless / special_tokens_map.json
suggisingh's picture
Training in progress, step 100
07b3482 verified
raw
history blame
94 Bytes
{
"bos_token": "<s>",
"eos_token": "</s>",
"pad_token": "PAD",
"unk_token": "[UNK]"
}