Spaces:

eson
/

tokenizer-arena

Running

App Files Files Community

tokenizer-arena / tokenizer /chinese_sptokenizer_patch.py

eson's picture

add compress rate

814ee6b 2 months ago

raw history blame

No virus

27 Bytes

	"""
	ref: glm_chinese
	"""