xaviviro
/

falcon-7b-quantized-gguf

Inference Endpoints

Model card Files Files and versions Community

falcon-7b-quantized-gguf

1 contributor

History: 11 commits

xaviviro's picture

Upload falcon-7b-q3_k_l.gguf with huggingface_hub

8622bea 11 months ago

.gitattributes

2.08 kB

Upload falcon-7b-q3_k_l.gguf with huggingface_hub 11 months ago
falcon-7b-fp16.gguf

4.21 GB
LFS

Upload falcon-7b-fp16.gguf with huggingface_hub 11 months ago
falcon-7b-fp32.gguf

28.9 GB
LFS

Upload falcon-7b-fp32.gguf with huggingface_hub 11 months ago
falcon-7b-q2_k.gguf

4.02 GB
LFS

Upload falcon-7b-q2_k.gguf with huggingface_hub 11 months ago
falcon-7b-q3_k_l.gguf

4.56 GB
LFS

Upload falcon-7b-q3_k_l.gguf with huggingface_hub 11 months ago
falcon-7b-q4_1.gguf

4.64 GB
LFS

Upload falcon-7b-q4_1.gguf with huggingface_hub 11 months ago
falcon-7b-q4_k_m.gguf

4.98 GB
LFS

Upload falcon-7b-q4_k_m.gguf with huggingface_hub 11 months ago
falcon-7b-q5_0.gguf

5.08 GB
LFS

Upload falcon-7b-q5_0.gguf with huggingface_hub 11 months ago
falcon-7b-q5_1.gguf

5.51 GB
LFS

Upload falcon-7b-q5_1.gguf with huggingface_hub 11 months ago
falcon-7b-q6_k.gguf

7.03 GB
LFS

Upload falcon-7b-q6_k.gguf with huggingface_hub 11 months ago
falcon-7b-q8_0.gguf

7.67 GB
LFS

Upload falcon-7b-q8_0.gguf with huggingface_hub 11 months ago