Mistral-7B-Instruct-v0.3 TIC
Bit-exact lossless .tic compression of mistralai/Mistral-7B-Instruct-v0.3.
Same weights. No quantization.
| Precision | BF16 |
| Raw weights | 14.50 GB |
.tic weights |
10.33 GB (28.8% savings) |
Benchmarks
Benchmarks for methodology and results.
Run
# Install
curl -fsSL https://isiro.ai/install.sh | sh
# Download .tic bundle
pip install -U huggingface_hub
hf download isiroai/Mistral-7B-Instruct-v0.3-TIC --local-dir Mistral-7B-Instruct-v0.3-TIC
# Serve (vLLM supported today)
isiro serve Mistral-7B-Instruct-v0.3-TIC --target vllm
Install options · Serve docs · Compile your own
Verify
Bit-exact checks. Hash manifest: model.tic.manifest.json.
# Confirm .tic integrity via the hash manifest
isiro verify Mistral-7B-Instruct-v0.3-TIC
# Optional: confirm .tic weights match the raw weights (requires compiler)
hf download mistralai/Mistral-7B-Instruct-v0.3 --local-dir Mistral-7B-Instruct-v0.3
isiro verify Mistral-7B-Instruct-v0.3-TIC -r Mistral-7B-Instruct-v0.3
License
Weights: same license as mistralai/Mistral-7B-Instruct-v0.3 (Apache-2.0).
.tic, ISIRO Runtime, and Compiler: ISIRO EULA.
- Downloads last month
- -