Kunger
/

Sakura-13B-Qwen2beta-v0.9-4bit-GS64-AWQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Sakura-13B-Qwen2beta-v0.9-4bit-GS64-AWQ / README.md

Kunger's picture

Update README.md

ce71c3a verified 7 months ago

|

No virus

202 Bytes

	---
	license: cc-by-nc-sa-4.0
	---

	原始模型：https://huggingface.co/SakuraLLM/Sakura-13B-Qwen2beta-v0.9

	4Bit AWQ量化，未测试，不建议使用。

	GroupSize=64

	适用于Kaggle双卡推理。