blaze-koneski / special_tokens_map.json
File size: 130 Bytes
bb96823
1
{"bos_token": "<|beginoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<unk>", "pad_token": "<PAD>", "mask_token": "<mask>"}