metadata
license: apache-2.0
library_name: gguf
pipeline_tag: text-generation
GGUF importance matrix (imatrix) quants for https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1
The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
| Layers | Context | Template |
|---|---|---|
32 |
32768 |
[INST] {prompt} [/INST] |