summary_loop24 / special_tokens_map.json
philippelaban's picture
Adding tokenizer and model files
3cfa2ed
raw
history blame contribute delete
89 Bytes
{"bos_token": "ĠST", "eos_token": "END", "unk_token": "<|endoftext|>", "pad_token": "!"}