scottlowry
/

Qwen3-Reranker-0.6B-oQ8e

8-bit precision

Model card Files Files and versions

Qwen3-Reranker-0.6B-oQ8e

This model was quantized using oQ (oMLX v0.6.4) mixed-precision quantization.

Quantization details

Model type: qwen3
Bits: 8
Group size: 64
Format: MLX safetensors

Downloads last month: 11

Safetensors

Model size

0.6B params

Tensor type

U32

·

BF16

·

MLX

Hardware compatibility

Log In to add your hardware

8-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for scottlowry/Qwen3-Reranker-0.6B-oQ8e

Base model

Qwen/Qwen3-0.6B-Base

Finetuned

Qwen/Qwen3-Reranker-0.6B

Quantized

(77)

this model