nmerkle
/

Meta-Llama-3-8B-Instruct-ggml-model-Q4_K_M.gguf

Model card Files Files and versions Community

Edit model card

Quantized Meta-Llama-3B-Instruct model

Tested inference on Raspberry PI Model 4 with llama.cpp. ~0.5 Tokens per second.

Downloads last month: 130

GGUF

Model size

8.03B params

Architecture

llama

Unable to determine this model's library. Check the docs .