Abzu
/

mpt-30b-instruct-q8

Text Generation

Inference Endpoints

text-generation-inference

8-bit precision

Model card Files Files and versions Community

mpt-30b-instruct-q8 / generation_config.json

Danivilanova's picture

Upload MPTForCausalLM

f8be025 11 months ago

raw history blame contribute delete

No virus

91 Bytes

	{
	"_from_model_config": true,
	"transformers_version": "4.30.2",
	"use_cache": false
	}