koelectra-base-finetuned-goemotions / tokenizer_config.json

Update tokenizer_config.json

83d8815 almost 4 years ago

No virus

234 Bytes

	{
	"do_lower_case": false,
	"max_len": 512,
	"unk_token": "[UNK]",
	"sep_token": "[SEP]",
	"pad_token": "[PAD]",
	"cls_token": "[CLS]",
	"mask_token": "[MASK]",
	"additional_special_tokens": ["[NAME]", "[RELIGION]"]
	}