NTDB-GPT2 / special_tokens_map.json
dracoglacius's picture
add tokenizer
180f75e
{"bos_token": "<START>", "eos_token": "<END>", "unk_token": "<UNK>"}