sam-mosaic
/

gpt-neox-20b-chatml

Model card Files Files and versions Community

gpt-neox-20b-chatml / special_tokens_map.json

sam-mosaic's picture

Upload tokenizer

ceb6f61 about 1 year ago

raw history blame contribute delete

No virus

174 Bytes

	{
	"additional_special_tokens": [
	"<\|im_start\|>",
	"<\|im_end\|>"
	],
	"bos_token": "<\|endoftext\|>",
	"eos_token": "<\|endoftext\|>",
	"unk_token": "<\|endoftext\|>"
	}