ethzanalytics
/

mpt-7b-storywriter-sharded

Text Generation

text-generation-inference

Model card Files Files and versions Community

mpt-7b-storywriter-sharded / generation_config.json

pszemraj's picture

increase max_new_tokens default

5e7cdb3 about 1 year ago

raw history blame

265 Bytes

	{
	"bos_token_id":0,
	"_from_model_config":false,
	"do_sample":true,
	"eos_token_id":0,
	"max_new_tokens":512,
	"no_repeat_ngram_size":10,
	"pad_token_id":0,
	"penalty_alpha":0.5,
	"repetition_penalty":1.05,
	"top_k":4,
	"transformers_version":"4.28.1"
	}