kuleshov
/

llama-7b-4bit

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

llama-7b-4bit / quant_config.json

kuleshov's picture

first commit

a227127 9 months ago

raw history blame contribute delete

No virus

175 Bytes

	{
	"dataset": "c4",
	"bits": 4,
	"nsamples": 128,
	"groupsize": 64,
	"act_order": true,
	"percdamp": 0.01,
	"seed": 0,
	"nearest": false,
	"save": "./llama-7b-4bit"
	}