takumi12
/

id2pg_pattern2_ja_b8e15_test

Model card Files Files and versions Community

id2pg_pattern2_ja_b8e15_test / added_tokens.json

takumi12's picture

Upload tokenizer

3acff90 about 1 year ago

history blame contribute delete

126 Bytes

	{
	"</s>": 2,
	"<s>": 1,
	"<unk>": 0,
	"▁<EOT>": 32010,
	"▁<MID>": 32009,
	"▁<PRE>": 32007,
	"▁<SUF>": 32008
	}