Spaces:

eson
/

tokenizer-arena

Running

update

751936e 11 months ago

No virus

237 Bytes




	## 跟 bert-chinese词典一样



	https://huggingface.co/ckiplab/gpt2-base-chinese
	https://huggingface.co/uer/gpt2-chinese-cluecorpussmall

	```json
	"tokenizer_class": "BertTokenizerFast",
	"vocab_size": 21128
	```


	## ss


	## ss