Spaces:

eson
/

tokenizer-arena

Running

App Files Files Community

tokenizer-arena / vocab /roberta_chinese_clue /README.md

eson's picture

add more tokenizers

f4973d4 8 months ago

|

No virus

80 Bytes


	删除了无用字符，词典更小。增加了少部分


	## 词典大小

	-