scottlowry
/

Qwen2.5-Coder-7B-oQ8e

8-bit precision

Model card Files Files and versions

Qwen2.5-Coder-7B-oQ8e

This model was quantized using oQ (oMLX v0.5.7) mixed-precision quantization.

Quantization details

Model type: qwen2
Bits: 8
Group size: 64
Format: MLX safetensors

Downloads last month: 294

Safetensors

Model size

2B params

Tensor type

BF16

·

U32

·

MLX

Hardware compatibility

Log In to add your hardware

8-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for scottlowry/Qwen2.5-Coder-7B-oQ8e

Base model

Qwen/Qwen2.5-7B

Finetuned

Qwen/Qwen2.5-Coder-7B

Quantized

(47)

this model