Spaces:

deepugaur
/

prompt_projectapp

Sleeping

prompt_projectapp / tokenizer.pkl

Create tokenizer.pkl

6bc66e8 verified 4 months ago

130 Bytes



	import pickle

	with open("tokenizer.pkl", "wb") as handle:
	pickle.dump(tokenizer, handle, protocol=pickle.HIGHEST_PROTOCOL)