squeeze-ai-lab
/

sq-llama-2-13b-w4-s0

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

sq-llama-2-13b-w4-s0 / quant_config.json

uvik's picture

Create quant_config.json

2b04c1a 10 months ago

No virus

18 Bytes

	{
	"wbits": 4
	}