squeeze-ai-lab
/

sq-llama-2-13b-w4-s0

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

sq-llama-2-13b-w4-s0 / quant_config.json

squeeze-ai-lab's picture

Create quant_config.json

8d76e30 10 months ago

history blame contribute delete

No virus

18 Bytes

	{
	"wbits": 4
	}