CyberRift
/

sidekick

Text Generation

large language model

text-generation-inference

Model card Files Files and versions Community

sidekick / special_tokens_map.json

Ahmed T

Upload tokenizer

0798acb about 1 year ago

195 Bytes

	{
	"bos_token": "<\|endoftext\|>",
	"cls_token": "<\|endoftext\|>",
	"eos_token": "<\|endoftext\|>",
	"pad_token": "<\|endoftext\|>",
	"sep_token": "<\|endoftext\|>",
	"unk_token": "<\|endoftext\|>"
	}