Mistral Nemo 12B (Mistral)
Parameters: 12.2B
Mixture of experts: no
Q4_K_M size: 6.96 GB
Q8_0 size: 12.13 GB
Minimum RAM for Q4: 9 GB
Default context length: 128K
Release: 2024-07
Ollama tag: mistral-nemo:12b
Ollama default download: 6.59 GB
Ollama pulls: 4.9M
Hugging Face: mistralai/Mistral-Nemo-Instruct-2407
HF downloads: 169024
HF likes: 1687
Model license: Apache-2.0 (commercial use: yes)
Notes: Mistral Nemo 12B, built with NVIDIA, 128K context. Q4_K_M and Q8_0 sizes from the bartowski GGUF repo.