You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

mixtral-8x7b-v0.1-streaming-bpw5

Near-lossless 5-bit compression (~1% perplexity; lossy) of mistralai/Mixtral-8x7B-v0.1 — produced by Sipsa Labs (UltraCompress).

  • Reproducible, cryptographically verifiable reconstruction: a deterministic decode to the SHA-256-pinned validated artifact (not bit-identical to the original bf16 model).
  • Independently perplexity-verified end-to-end.
  • License: BUSL-1.1 + Additional Use Grant.
pip install ultracompress

Documentation & verification: https://sipsalabs.com · https://github.com/sipsalabs/ultracompress

Patents pending.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for SipsaLabs/mixtral-8x7b-v0.1-streaming-bpw5

Finetuned
(76)
this model