ydshieh
/

test-dynamic-processor

Model card Files Files and versions Community

test-dynamic-processor / custom_tokenization.py

ydshieh's picture

ydshieh HF staff

commit files to HF hub

990cd1d 5 months ago

raw history blame contribute delete

No virus

88 Bytes

	from transformers import BertTokenizer


	class CustomTokenizer(BertTokenizer):
	pass