Qwen3-Embedding-8B — MLX BF16

BF16 reference checkpoint for this matched local sweep.

This is the BF16 MLX conversion checkpoint from a matched local embedding-quantization experiment. It is published with explicit lineage, calibration evidence where applicable, and the bounded evaluation result that accompanied the conversion.

Provenance and lineage

  • Upstream model: Qwen/Qwen3-Embedding-8B
  • Upstream revision recorded for publication: 1d8ad4ca9b3dd8059ad90a75d4983776a23d44af
  • Revision evidence: exact source snapshot retained in the local Hugging Face download metadata
  • Direct parent: Qwen/Qwen3-Embedding-8B
  • Conversion rule: every quantized checkpoint branches directly from the family MLX BF16 checkpoint; no lossy checkpoint was used to create another.
  • Quantization: BF16 MLX conversion
  • Local conversion stack: oMLX 0.5.3, mlx-lm 0.31.3, MLX 0.32.0
  • Full collection: MLX Embedding Quantization Matrix

PROVENANCE.json contains machine-readable lineage and SHA-256 hashes for the published weight files. No importance matrix was used for this checkpoint.

Bounded local evaluation

Role Retrieval smoke
BF16 reference 24/24 top-1, MRR 1.0

The evaluation used 24 frozen query/document pairs, the upstream query instruction recipe, last-token pooling, L2 normalization, and direct comparison with vectors from the family BF16 checkpoint. This is an engineering smoke test, not MTEB and not a claim of universal quality. Retrieval success and representation fidelity are reported separately.

Runtime scope

This checkpoint targets Apple Silicon through MLX/oMLX. CUDA and PyTorch results are a separate control lane and must not be interpreted as measurements of MLX/Metal kernel performance.

License and attribution

Apache-2.0, following the upstream model card. The original model authors retain attribution for the upstream model; this repository contains a local MLX conversion or quantized derivative prepared by TiGa-RCE for reproducibility research.

Downloads last month
-
Safetensors
Model size
8B params
Tensor type
BF16
·
MLX
Hardware compatibility
Log In to add your hardware

Quantized

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for TiGa-RCE/Qwen3-Embedding-8B-MLX-BF16

Finetuned
(40)
this model

Collection including TiGa-RCE/Qwen3-Embedding-8B-MLX-BF16