peft-internal-testing
/

tiny-random-OPTForCausalLM-extended-vocab

Model card Files Files and versions Community

tiny-random-OPTForCausalLM-extended-vocab / added_tokens.json

smangrul's picture

Upload tokenizer

66a878b verified 5 months ago

raw history blame contribute delete

No virus

120 Bytes

	{
	"<\|im_end\|>": 50265,
	"<\|im_start\|>assistant": 50267,
	"<\|im_start\|>system": 50268,
	"<\|im_start\|>user": 50266
	}