stabilityai
/

stablelm-2-1_6b

Text Generation

Inference Endpoints

Model card Files Files and versions Community

stablelm-2-1_6b / tokenizer_config.json

jon-tow's picture

fix: revert zephyr tokenizer config change

192936b verified 10 months ago

160 Bytes

	{
	"tokenizer_class": "Arcade100kTokenizer",
	"auto_map": {
	"AutoTokenizer": [
	"tokenization_arcade100k.Arcade100kTokenizer",
	null
	]
	}
	}