prudant
/

Tess-v2.5.2-Qwen2-72B-AWQ

Text Generation

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Edit model card

Tess-v2.5.2 (Qwen2-72B) AWQ

This is the AWQ GEMM quant version of the Tess-v2.5.2

Original model :https://huggingface.co/migtissera/Tess-v2.5.2-Qwen2-72B

Downloads last month: 494

Safetensors

Model size

11.9B params

Tensor type

I32

·

FP16

·