Kasivs
/

SQLGenerator

Text2Text Generation

text-generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

SQLGenerator / tokenizer.json

Kasivs's picture

Create tokenizer.json

4387ce7 verified 4 months ago

155 Bytes

	from transformers import BertTokenizer

	tokenizer = BertTokenizer.from_pretrained("bert-base-uncased")
	tokenizer.save_pretrained("path_to_save_tokenizer")