maddes8cht
/

tiiuae-falcon-7b-gguf

Model card Files Files and versions Community

tiiuae-falcon-7b-gguf

1 contributor

History: 54 commits

maddes8cht's picture

upload tiiuae-falcon-7b-Q6_K.gguf

bb497af 9 months ago

.gitattributes

2.44 kB

upload tiiuae-falcon-7b-Q6_K.gguf 9 months ago
README.md

14.3 kB

"Update README.md" 9 months ago
ggml-tiiuae-falcon-7b-Q4_0.gguf

4.21 GB
LFS

upload ggml-tiiuae-falcon-7b-Q4_0.gguf 9 months ago
ggml-tiiuae-falcon-7b-Q4_1.gguf

4.64 GB
LFS

upload ggml-tiiuae-falcon-7b-Q4_1.gguf 9 months ago
ggml-tiiuae-falcon-7b-Q5_0.gguf

5.08 GB
LFS

upload ggml-tiiuae-falcon-7b-Q5_0.gguf 9 months ago
ggml-tiiuae-falcon-7b-Q5_1.gguf

5.51 GB
LFS

upload ggml-tiiuae-falcon-7b-Q5_1.gguf 9 months ago
ggml-tiiuae-falcon-7b-Q8_0.gguf

7.67 GB
LFS

upload ggml-tiiuae-falcon-7b-Q8_0.gguf 9 months ago
tiiuae-falcon-7b-Q2_K.gguf

4.03 GB
LFS

upload tiiuae-falcon-7b-Q2_K.gguf 9 months ago
tiiuae-falcon-7b-Q3_K_L.gguf

4.56 GB
LFS

upload tiiuae-falcon-7b-Q3_K_L.gguf 9 months ago
tiiuae-falcon-7b-Q3_K_M.gguf

4.37 GB
LFS

upload tiiuae-falcon-7b-Q3_K_M.gguf 9 months ago
tiiuae-falcon-7b-Q3_K_S.gguf

4.13 GB
LFS

upload tiiuae-falcon-7b-Q3_K_S.gguf 9 months ago
tiiuae-falcon-7b-Q4_K_M.gguf

4.98 GB
LFS

upload tiiuae-falcon-7b-Q4_K_M.gguf 9 months ago
tiiuae-falcon-7b-Q4_K_S.gguf

4.75 GB
LFS

upload tiiuae-falcon-7b-Q4_K_S.gguf 9 months ago
tiiuae-falcon-7b-Q5_K_M.gguf

5.73 GB
LFS

upload tiiuae-falcon-7b-Q5_K_M.gguf 9 months ago
tiiuae-falcon-7b-Q5_K_S.gguf

5.34 GB
LFS

upload tiiuae-falcon-7b-Q5_K_S.gguf 9 months ago
tiiuae-falcon-7b-Q6_K.gguf

7.03 GB
LFS

upload tiiuae-falcon-7b-Q6_K.gguf 9 months ago