KoboldAI
/

GPT-NeoX-20B-Skein

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

GPT-NeoX-20B-Skein / tokenizer_config.json

Henk717's picture

Update tokenizer_config.json

d615ce2 over 1 year ago

raw history blame contribute delete

No virus

157 Bytes

	{"unk_token": "<\|endoftext\|>", "bos_token": "<\|endoftext\|>", "eos_token": "<\|endoftext\|>", "add_prefix_space": false, "tokenizer_class": "GPTNeoXTokenizer"}