neopolita
/

llama-3.2-3b-instruct-gguf

Inference Endpoints

Model card Files Files and versions Community

llama-3.2-3b-instruct-gguf

1 contributor

History: 9 commits

neopolita's picture

Upload llama-3.2-3b-instruct_q8_0.gguf with huggingface_hub

b538511 verified 3 months ago

.gitattributes

1.99 kB

Upload llama-3.2-3b-instruct_q8_0.gguf with huggingface_hub 3 months ago
README.md

1.44 kB

Upload README.md with huggingface_hub 3 months ago
ggml-model-f16.gguf

6.43 GB
LFS

Upload ggml-model-f16.gguf with huggingface_hub 3 months ago
llama-3.2-3b-instruct_q2_k.gguf

1.36 GB
LFS

Upload llama-3.2-3b-instruct_q2_k.gguf with huggingface_hub 3 months ago
llama-3.2-3b-instruct_q3_k_m.gguf

1.69 GB
LFS

Upload llama-3.2-3b-instruct_q3_k_m.gguf with huggingface_hub 3 months ago
llama-3.2-3b-instruct_q4_k_m.gguf

2.02 GB
LFS

Upload llama-3.2-3b-instruct_q4_k_m.gguf with huggingface_hub 3 months ago
llama-3.2-3b-instruct_q5_k_m.gguf

2.32 GB
LFS

Upload llama-3.2-3b-instruct_q5_k_m.gguf with huggingface_hub 3 months ago
llama-3.2-3b-instruct_q6_k.gguf

2.64 GB
LFS

Upload llama-3.2-3b-instruct_q6_k.gguf with huggingface_hub 3 months ago
llama-3.2-3b-instruct_q8_0.gguf

3.42 GB
LFS

Upload llama-3.2-3b-instruct_q8_0.gguf with huggingface_hub 3 months ago