TokenBender
/

Navarna_v0_1_OpenHermes_Hindi

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Navarna_v0_1_OpenHermes_Hindi / added_tokens.json

TokenBender's picture

Upload tokenizer

9610af4 verified 5 months ago

raw history blame contribute delete

No virus

51 Bytes

	{
	"<\|im_end\|>": 32000,
	"<\|im_start\|>": 32001
	}