stanford-crfm
/

levanter-gpt

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

levanter-gpt / special_tokens_map.json

dlwh's picture

apparently one needs the tokenizer

ede4e43 about 2 years ago

history blame contribute delete

99 Bytes

	{
	"bos_token": "<\|endoftext\|>",
	"eos_token": "<\|endoftext\|>",
	"unk_token": "<\|endoftext\|>"
	}