Hugging Face's logo

klosax
/
openllama-3b-v2-gguf

GGUF
Inference Endpoints
Model card Files Community
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Source model: https://huggingface.co/openlm-research/open_llama_3b_v2

Converted to GGML latest model file format gguf.

https://github.com/ggerganov/llama.cpp

Downloads last month
51
GGUF
Model size
3.43B params
Architecture
llama

4-bit

5-bit

8-bit

16-bit

Inference API
Unable to determine this model's library. Check the docs .