TheBloke
/

yi-34B-v3-GGUF

Model card Files Files and versions Community

1 contributor

History: 14 commits

TheBloke's picture

GGUF model commit (made with llama.cpp commit 6744dbe)

8237f34 11 months ago

.gitattributes

2.21 kB

GGUF model commit (made with llama.cpp commit 6744dbe) 11 months ago
config.json

26 Bytes

GGUF model commit (made with llama.cpp commit 6744dbe) 11 months ago
yi-34b-v3.Q2_K.gguf

14.6 GB
LFS

GGUF model commit (made with llama.cpp commit 6744dbe) 11 months ago
yi-34b-v3.Q3_K_L.gguf

18.1 GB
LFS

GGUF model commit (made with llama.cpp commit 6744dbe) 11 months ago
yi-34b-v3.Q3_K_M.gguf

16.6 GB
LFS

GGUF model commit (made with llama.cpp commit 6744dbe) 11 months ago
yi-34b-v3.Q3_K_S.gguf

15 GB
LFS

GGUF model commit (made with llama.cpp commit 6744dbe) 11 months ago
yi-34b-v3.Q4_0.gguf

19.5 GB
LFS

GGUF model commit (made with llama.cpp commit 6744dbe) 11 months ago
yi-34b-v3.Q4_K_M.gguf

20.7 GB
LFS

GGUF model commit (made with llama.cpp commit 6744dbe) 11 months ago
yi-34b-v3.Q4_K_S.gguf

19.5 GB
LFS

GGUF model commit (made with llama.cpp commit 6744dbe) 11 months ago
yi-34b-v3.Q5_0.gguf

23.7 GB
LFS

GGUF model commit (made with llama.cpp commit 6744dbe) 11 months ago
yi-34b-v3.Q5_K_M.gguf

24.3 GB
LFS

GGUF model commit (made with llama.cpp commit 6744dbe) 11 months ago
yi-34b-v3.Q5_K_S.gguf

23.7 GB
LFS

GGUF model commit (made with llama.cpp commit 6744dbe) 11 months ago
yi-34b-v3.Q6_K.gguf

28.2 GB
LFS

GGUF model commit (made with llama.cpp commit 6744dbe) 11 months ago
yi-34b-v3.Q8_0.gguf

36.5 GB
LFS

GGUF model commit (made with llama.cpp commit 6744dbe) 11 months ago