aguila-7b-8bit / quantize_config.json

projecte-aina/aguila-7b: 8bits, gr128, desc_act=False

6a9bad2 7 months ago

No virus

241 Bytes

	{
	"bits": 8,
	"group_size": 128,
	"damp_percent": 0.01,
	"desc_act": false,
	"static_groups": false,
	"sym": true,
	"true_sequential": true,
	"model_name_or_path": "aguila-7b-8bit",
	"model_file_base_name": "gptq_model-8bit-128g"
	}