clip-huge-zh-75k-steps-bs4096 / tokenizer_config.json

Upload 9 files

54ba542 over 1 year ago

No virus

258 Bytes

	{

	"cls_token": "[CLS]",
	"mask_token": "[MASK]",
	"unk_token": "[UNK]",
	"tokenizer_class": "CLIPTokenizerRoberta",
	"use_fast": true,
	"auto_map": {
	"AutoTokenizer": [
	"clip_tokenizer_roberta.CLIPTokenizerRoberta",
	null
	]
	}
	}