prithivMLmods
/

Meta-Llama-3.2-1B-GGUF-QX

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3.2-1B-GGUF-QX

1 contributor

History: 19 commits

prithivMLmods's picture

Create img/demo.txt

0576b6a verified 28 days ago

img
Create img/demo.txt 28 days ago
.gitattributes

1.85 kB

Update .gitattributes 28 days ago
Llama-3.2-1B-GGUF-QX.Q4_K_M.gguf

808 MB
LFS

Rename unsloth.Q4_K_M.gguf to Llama-3.2-1B-GGUF-QX.Q4_K_M.gguf 28 days ago
Llama-3.2-1B-GGUF-QX.Q5_K_M.gguf

912 MB
LFS

Rename unsloth.Q5_K_M.gguf to Llama-3.2-1B-GGUF-QX.Q5_K_M.gguf 28 days ago
Llama-3.2-1B-GGUF-QX.Q8_0.gguf

1.32 GB
LFS

Rename unsloth.Q8_0.gguf to Llama-3.2-1B-GGUF-QX.Q8_0.gguf 28 days ago
Llama-3.2-1B-GGUF.F16.gguf

2.48 GB
LFS

Rename Llama-3.2-1B-GGUF-QX.F16.gguf to Llama-3.2-1B-GGUF.F16.gguf 28 days ago
Modelfile

1.96 kB

Update Modelfile 28 days ago
README.md

3.72 kB

Update README.md 28 days ago
config.json

29 Bytes

(Trained with Unsloth) 28 days ago