spacerini
/

bpe-imdb-25k

Model card Files Files and versions Community

bpe-imdb-25k / tokenizer_config.json

cakiki's picture

Upload tokenizer

47c190a over 1 year ago

raw history blame contribute delete

No virus

129 Bytes

	{
	"model_max_length": 1000000000000000019884624838656,
	"tokenizer_class": "PreTrainedTokenizerFast",
	"vocab_size": 25000
	}