Mixtral 8x7B (Mistral)
Parameters: 46.7B
Mixture of experts: yes
Active parameters (MoE): 12.9B
Q4_K_M size: 26.49 GB
Q8_0 size: 46.22 GB
Minimum RAM for Q4: 30 GB
Default context length: 32K
Release: 2023-12
Ollama tag: mixtral:8x7b
Ollama default download: 24.63 GB
Ollama pulls: 2.7M
Hugging Face: mistralai/Mixtral-8x7B-Instruct-v0.1
HF downloads: 565312
HF likes: 4701
Model license: Apache-2.0 (commercial use: yes)
Notes: Mixtral 8x7B sparse MoE: 46.7B total, 12.9B active (2 of 8 experts per token). All experts must fit in memory. Q4_K_M and Q8_0 sizes from the MaziyarPanahi GGUF repo.