cyrilzhang
/

wiki-bpe-64k

Model card Files Files and versions Community

wiki-bpe-64k / special_tokens_map.json

cyrilzhang's picture

Upload tokenizer

73f5752 9 months ago

raw history blame contribute delete

No virus

55 Bytes

	{
	"eos_token": "<\|eos\|>",
	"pad_token": "<\|pad\|>"
	}