GGUF model commit (made with llama.cpp commit d96ca7d)

3c9ace3 12 months ago

.gitattributes

2.22 kB

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
README.md

21.7 kB

Upload README.md 12 months ago
config.json

26 Bytes

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
yi-6b-200k.Q2_K.gguf

2.62 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q3_K_L.gguf

3.24 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q3_K_M.gguf

2.99 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q3_K_S.gguf

2.71 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q4_0.gguf

3.48 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q4_K_M.gguf

3.67 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q4_K_S.gguf

3.5 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q5_0.gguf

4.2 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q5_K_M.gguf

4.3 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q5_K_S.gguf

4.2 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q6_K.gguf

4.97 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
yi-6b-200k.Q8_0.gguf

6.44 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago