Spaces:

eson
/

tokenizer-arena

Running

App Files Files Community

tokenizer-arena / vocab /baichuan7b_chat /__init__.py

eson's picture

add more tokenizers

f4973d4 7 months ago

raw history blame

No virus

31 Bytes

	"""
	"vocab_size": 125696
	"""