xaviviro
/

falcon-7b-quantized-gguf

Inference Endpoints

Model card Files Files and versions Community

falcon-7b-quantized-gguf

1 contributor

History: 9 commits

xaviviro's picture

Upload falcon-7b-q4_k_m.gguf with huggingface_hub

5041e0e 11 months ago

.gitattributes

1.97 kB

Upload falcon-7b-q4_k_m.gguf with huggingface_hub 11 months ago
falcon-7b-fp32.gguf

28.9 GB
LFS

Upload falcon-7b-fp32.gguf with huggingface_hub 11 months ago
falcon-7b-q2_k.gguf

4.02 GB
LFS

Upload falcon-7b-q2_k.gguf with huggingface_hub 11 months ago
falcon-7b-q4_1.gguf

4.64 GB
LFS

Upload falcon-7b-q4_1.gguf with huggingface_hub 11 months ago
falcon-7b-q4_k_m.gguf

4.98 GB
LFS

Upload falcon-7b-q4_k_m.gguf with huggingface_hub 11 months ago
falcon-7b-q5_0.gguf

5.08 GB
LFS

Upload falcon-7b-q5_0.gguf with huggingface_hub 11 months ago
falcon-7b-q5_1.gguf

5.51 GB
LFS

Upload falcon-7b-q5_1.gguf with huggingface_hub 11 months ago
falcon-7b-q6_k.gguf

7.03 GB
LFS

Upload falcon-7b-q6_k.gguf with huggingface_hub 11 months ago
falcon-7b-q8_0.gguf

7.67 GB
LFS

Upload falcon-7b-q8_0.gguf with huggingface_hub 11 months ago