neopolita
/

falcon-11b-gguf

Inference Endpoints

Model card Files Files and versions Community

falcon-11b-gguf

1 contributor

History: 10 commits

neopolita's picture

Upload falcon-11b_q6_k.gguf with huggingface_hub

f56de2f verified 8 months ago

.gitattributes

1.87 kB

Upload falcon-11b_q6_k.gguf with huggingface_hub 8 months ago
README.md

1.4 kB

Upload README.md with huggingface_hub 8 months ago
falcon-11b_q2_k.gguf

4.25 GB
LFS

Upload falcon-11b_q2_k.gguf with huggingface_hub 8 months ago
falcon-11b_q3_k_m.gguf

5.44 GB
LFS

Upload falcon-11b_q3_k_m.gguf with huggingface_hub 8 months ago
falcon-11b_q4_k_m.gguf

6.85 GB
LFS

Upload falcon-11b_q4_k_m.gguf with huggingface_hub 8 months ago
falcon-11b_q5_k_m.gguf

8.2 GB
LFS

Upload falcon-11b_q5_k_m.gguf with huggingface_hub 8 months ago
falcon-11b_q6_k.gguf

9.18 GB
LFS

Upload falcon-11b_q6_k.gguf with huggingface_hub 8 months ago
ggml-model-f16.gguf

22.2 GB
LFS

Upload ggml-model-f16.gguf with huggingface_hub 8 months ago