Llama 3.1 8B (Llama)
Parameters: 8B
Mixture of experts: no
Q4_K_M size: 4.92 GB
Q8_0 size: 8.54 GB
Minimum RAM for Q4: 8 GB
Default context length: 128K
Release: 2024-07
Ollama tag: llama3.1:8b
Ollama default download: 4.58 GB
Ollama pulls: 111M
Hugging Face: meta-llama/Llama-3.1-8B-Instruct
HF downloads: 9034017
HF likes: 6230
Model license: Llama 3.1 Community (commercial use: conditional)
License note: Llama 3.1 Community License: free under 700M MAU.
LMArena Elo: 1211 (rank 293)
BFCL v3 accuracy: 25.8
Notes: Q4_K_M and Q8_0 sizes from bartowski HF repo. Default ollama tag pulls 4.9GB Q4_K_M. Min RAM estimate includes model + small KV cache overhead.