GGUF model commit (made with llama.cpp commit 8a7b2fa)

3c5aa61 11 months ago

.gitattributes

2.11 kB

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
README.md

16.1 kB

Update README.md 11 months ago
config.json

31 Bytes

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
mixtral-8x7b-instruct-v0.1.Q2_K.gguf

15.6 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
mixtral-8x7b-instruct-v0.1.Q3_K_M.gguf

20.4 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
mixtral-8x7b-instruct-v0.1.Q4_0.gguf

26.4 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
mixtral-8x7b-instruct-v0.1.Q4_K_M.gguf

26.4 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
mixtral-8x7b-instruct-v0.1.Q5_0.gguf

32.2 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf

32.2 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
mixtral-8x7b-instruct-v0.1.Q6_K.gguf

38.4 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
mixtral-8x7b-instruct-v0.1.Q8_0.gguf

49.6 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago