Spaces:

xu-song
/

tokenizer-arena

Running

tokenizer-arena / vocab /kplug /__init__.py

update

d10ecd7 about 1 year ago

127 Bytes


	from transformers import BertTokenizer

	tokenizer = BertTokenizer.from_pretrained("eson/kplug-base-encoder")
	print(tokenizer)