Kunger
/

Sakura-13B-v0.11Pre-4Bit-AWQ

Text Generation

4-bit precision

Model card Files Files and versions Community

Sakura-13B-v0.11Pre-4Bit-AWQ / README.md

Kunger's picture

Update README.md

ac38a99 verified 4 months ago

|

history blame contribute delete

No virus

232 Bytes

	---
	license: cc-by-nc-sa-4.0
	---

	原始模型:[Sakura-13B-LNovel-v0.11pre1](https://huggingface.co/SakuraLLM/Sakura-13B-LNovel-v0.11pre1)

	4Bit AWQ量化，未测试，不建议使用。

	采用带有flash_attn的环境进行量化