GGUF model commit (made with llama.cpp commit 8a7b2fa)

69b1a56 11 months ago

.gitattributes

2.11 kB

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
README.md

16.1 kB

Update README.md 11 months ago
config.json

31 Bytes

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
mixtral-8x7b-instruct-v0.1.Q2_K.gguf

15.6 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
mixtral-8x7b-instruct-v0.1.Q3_K_M.gguf

20.4 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
mixtral-8x7b-instruct-v0.1.Q4_0.gguf

26.4 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
mixtral-8x7b-instruct-v0.1.Q4_K_M.gguf

26.4 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
mixtral-8x7b-instruct-v0.1.Q5_0.gguf

32.2 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf

32.2 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
mixtral-8x7b-instruct-v0.1.Q6_K.gguf

38.4 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
mixtral-8x7b-instruct-v0.1.Q8_0.gguf

49.6 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago