qwopqwop
/

test-awq

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

test-awq / quant_config.json

qwopqwop's picture

Upload of AutoQuant quantized model

69f2a54 11 months ago

history blame contribute delete

No virus

124 Bytes

	{
	"bits": 4,
	"group_size": 128,
	"zero_point": true,
	"auto_scale": true,
	"mse_range": true,
	"quant_type": "AWQ"
	}