Edit model card

Quantized Meta-Llama-3B-Instruct model

Tested inference on Raspberry PI Model 4 with llama.cpp. ~0.5 Tokens per second.

Downloads last month
130
GGUF
Model size
8.03B params
Architecture
llama
Unable to determine this model's library. Check the docs .