monsoon-nlp
/

dna-blockdiff-2

Model card Files Files and versions Community

dna-blockdiff-2 / tokenizer_config.json

monsoon-nlp's picture

Upload 3 files

e98a5a6 verified about 2 months ago

history blame contribute delete

132 Bytes

	{
	"clean_up_tokenization_spaces": true,
	"eos_token": "<eos>",
	"model_max_length": 1024,
	"tokenizer_class": "EsmTokenizer"
	}