Qwen
/

Qwen-tokenizer

Model card Files Files and versions Community

Qwen-tokenizer / added_tokens.json

JustinLin610's picture

Upload 6 files

5909c82 verified 5 months ago

raw history blame contribute delete

No virus

80 Bytes

	{
	"<\|endoftext\|>": 151643,
	"<\|im_end\|>": 151645,
	"<\|im_start\|>": 151644
	}