macedonizer
/

blaze-koneski

blaze-koneski / special_tokens_map.json

initial commit

bb96823 over 2 years ago

No virus

130 Bytes

{"bos_token": "<|beginoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<unk>", "pad_token": "<PAD>", "mask_token": "<mask>"}