Qwopus3-5-9B-Coder-Flash-oQ4e-mtp

This is an oQ4e MLX conversion produced with oMLX.

Source and credit

Please follow the original model's license, acceptable-use policy, and attribution requirements.

Conversion

  • Quantization: oQ4e (enhanced=True)
  • Importance calibration: imatrix, 128 samples × 512 tokens
  • oMLX version: 0.6.3rc2

oQe uses an imatrix sensitivity calibration to assign precision selectively, rather than applying a uniform bit-width to every tensor. The generated oq_imatrix_report.json records the resulting quantization allocation.

python run_oqe_conversion.py Qwopus3-5-9B-Coder-Flash-bf16 --models-dir /path/to/models --oq-level 4.0 --imatrix-samples 128 --imatrix-seq-length 512 --source-repo https://huggingface.co/Jackrong/Qwopus3-5-9B-Coder-Flash

Files

  • model.safetensors or model-*-of-*.safetensors: quantized MLX weights
  • model.safetensors.index.json: shard index (present for sharded outputs)
  • config.json: model configuration
  • oq_imatrix_report.json: imatrix calibration and quantization report
Downloads last month
10
Safetensors
Model size
10B params
Tensor type
U32
·
BF16
·
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support