Kunger
/

Sakura-13B-Qwen2beta-v0.9-4bit-AWQ

Text Generation

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Edit model card

原始模型：https://huggingface.co/SakuraLLM/Sakura-13B-Qwen2beta-v0.9

4Bit AWQ量化，未测试，不建议使用。

Downloads last month: 8

Safetensors

Model size

3.25B params

Tensor type

I32

·

FP16

·