Spaces:

eson
/

tokenizer-arena

Running

tokenizer-arena / vocab /kplug /__init__.py

update

d10ecd7 11 months ago

No virus

127 Bytes


	from transformers import BertTokenizer

	tokenizer = BertTokenizer.from_pretrained("eson/kplug-base-encoder")
	print(tokenizer)