1 contributor

History: 14 commits

TheBloke

GGUF model commit (made with llama.cpp commit 2923f17)

b1f6206 11 months ago

.gitattributes

2.35 kB

GGUF model commit (made with llama.cpp commit 2923f17) 11 months ago
config.json

32 Bytes

GGUF model commit (made with llama.cpp commit 2923f17) 11 months ago
nanbeige-16b-chat-32k.Q2_K.gguf

6.64 GB
LFS

GGUF model commit (made with llama.cpp commit 2923f17) 11 months ago
nanbeige-16b-chat-32k.Q3_K_L.gguf

8.45 GB
LFS

GGUF model commit (made with llama.cpp commit 2923f17) 11 months ago
nanbeige-16b-chat-32k.Q3_K_M.gguf

7.74 GB
LFS

GGUF model commit (made with llama.cpp commit 2923f17) 11 months ago
nanbeige-16b-chat-32k.Q3_K_S.gguf

6.93 GB
LFS

GGUF model commit (made with llama.cpp commit 2923f17) 11 months ago
nanbeige-16b-chat-32k.Q4_0.gguf

8.99 GB
LFS

GGUF model commit (made with llama.cpp commit 2923f17) 11 months ago
nanbeige-16b-chat-32k.Q4_K_M.gguf

9.59 GB
LFS

GGUF model commit (made with llama.cpp commit 2923f17) 11 months ago
nanbeige-16b-chat-32k.Q4_K_S.gguf

9.04 GB
LFS

GGUF model commit (made with llama.cpp commit 2923f17) 11 months ago
nanbeige-16b-chat-32k.Q5_0.gguf

10.9 GB
LFS

GGUF model commit (made with llama.cpp commit 2923f17) 11 months ago
nanbeige-16b-chat-32k.Q5_K_M.gguf

11.2 GB
LFS

GGUF model commit (made with llama.cpp commit 2923f17) 11 months ago
nanbeige-16b-chat-32k.Q5_K_S.gguf

10.9 GB
LFS

GGUF model commit (made with llama.cpp commit 2923f17) 11 months ago
nanbeige-16b-chat-32k.Q6_K.gguf

13 GB
LFS

GGUF model commit (made with llama.cpp commit 2923f17) 11 months ago
nanbeige-16b-chat-32k.Q8_0.gguf

16.8 GB
LFS

GGUF model commit (made with llama.cpp commit 2923f17) 11 months ago