SafeMathBot / special_tokens_map.json
lichenglu's picture
Move tokenizer files to root
95739ab
{"bos_token": "<bos>", "eos_token": "<eos>", "unk_token": "<|endoftext|>", "additional_special_tokens": ["[SAFE]", "[UNSAFE]", "[OK]", "[SELF_M]", "[SELF_F]", "[SELF_N]", "[PARTNER_M]", "[PARTNER_F]", "[PARTNER_N]", "[ABOUT_M]", "[ABOUT_F]", "[ABOUT_N]", "<speaker1>", "<speaker2>"]}