GGUF model commit (made with llama.cpp commit 20c7e1e)

375c4c9 10 months ago

.gitattributes

2.28 kB

GGUF model commit (made with llama.cpp commit 20c7e1e) 10 months ago
config.json

31 Bytes

GGUF model commit (made with llama.cpp commit 20c7e1e) 10 months ago
mistral-7b-v0.1.Q2_K.gguf

3.08 GB
LFS

GGUF model commit (made with llama.cpp commit 20c7e1e) 10 months ago
mistral-7b-v0.1.Q3_K_L.gguf

3.82 GB
LFS

GGUF model commit (made with llama.cpp commit 20c7e1e) 10 months ago
mistral-7b-v0.1.Q3_K_M.gguf

3.52 GB
LFS

GGUF model commit (made with llama.cpp commit 20c7e1e) 10 months ago
mistral-7b-v0.1.Q3_K_S.gguf

3.16 GB
LFS

GGUF model commit (made with llama.cpp commit 20c7e1e) 10 months ago
mistral-7b-v0.1.Q4_0.gguf

4.11 GB
LFS

GGUF model commit (made with llama.cpp commit 20c7e1e) 10 months ago
mistral-7b-v0.1.Q4_K_M.gguf

4.37 GB
LFS

GGUF model commit (made with llama.cpp commit 20c7e1e) 10 months ago
mistral-7b-v0.1.Q4_K_S.gguf

4.14 GB
LFS

GGUF model commit (made with llama.cpp commit 20c7e1e) 10 months ago
mistral-7b-v0.1.Q5_0.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit 20c7e1e) 10 months ago
mistral-7b-v0.1.Q5_K_M.gguf

5.13 GB
LFS

GGUF model commit (made with llama.cpp commit 20c7e1e) 10 months ago
mistral-7b-v0.1.Q5_K_S.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit 20c7e1e) 10 months ago
mistral-7b-v0.1.Q6_K.gguf

5.94 GB
LFS

GGUF model commit (made with llama.cpp commit 20c7e1e) 10 months ago
mistral-7b-v0.1.Q8_0.gguf

7.7 GB
LFS

GGUF model commit (made with llama.cpp commit 20c7e1e) 10 months ago