Mistral-7B-Instruct-v0.3 TIC

Bit-exact lossless .tic compression of mistralai/Mistral-7B-Instruct-v0.3.

Same weights. No quantization.

What is TIC?

Precision BF16
Raw weights 14.50 GB
.tic weights 10.33 GB (28.8% savings)

Benchmarks

Benchmarks for methodology and results.

Run

# Install
curl -fsSL https://isiro.ai/install.sh | sh

# Download .tic bundle
pip install -U huggingface_hub
hf download isiroai/Mistral-7B-Instruct-v0.3-TIC --local-dir Mistral-7B-Instruct-v0.3-TIC

# Serve (vLLM supported today)
isiro serve Mistral-7B-Instruct-v0.3-TIC --target vllm

Install options · Serve docs · Compile your own

Verify

Bit-exact checks. Hash manifest: model.tic.manifest.json.

# Confirm .tic integrity via the hash manifest
isiro verify Mistral-7B-Instruct-v0.3-TIC

# Optional: confirm .tic weights match the raw weights (requires compiler)
hf download mistralai/Mistral-7B-Instruct-v0.3 --local-dir Mistral-7B-Instruct-v0.3
isiro verify Mistral-7B-Instruct-v0.3-TIC -r Mistral-7B-Instruct-v0.3

License

Weights: same license as mistralai/Mistral-7B-Instruct-v0.3 (Apache-2.0).

.tic, ISIRO Runtime, and Compiler: ISIRO EULA.

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support