Mozilla
/

Mixtral-8x7B-Instruct-v0.1-llamafile

text-generation-inference

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0.1-llamafile

1 contributor

History: 17 commits

jartine's picture

Add mixtral-8x7b-instruct-v0.1.Q6_K.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a

40eb574 7 months ago

.gitattributes
2.66 kB

Add mixtral-8x7b-instruct-v0.1.Q6_K.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a 7 months ago
README.md
20.7 kB

Add README.md to repo 7 months ago
config.json
31 Bytes

Add config.json to repo 7 months ago
mixtral-8x7b-instruct-v0.1.Q2_K.llamafile
15.7 GB
LFS

Add mixtral-8x7b-instruct-v0.1.Q2_K.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a 7 months ago
mixtral-8x7b-instruct-v0.1.Q3_K_M.llamafile
20.4 GB
LFS

Add mixtral-8x7b-instruct-v0.1.Q3_K_M.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a 7 months ago
mixtral-8x7b-instruct-v0.1.Q4_0.llamafile
26.5 GB
LFS

Add mixtral-8x7b-instruct-v0.1.Q4_0.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a 7 months ago
mixtral-8x7b-instruct-v0.1.Q4_K_M.llamafile
26.5 GB
LFS

Add mixtral-8x7b-instruct-v0.1.Q4_K_M.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a 7 months ago
mixtral-8x7b-instruct-v0.1.Q5_0.llamafile
32.2 GB
LFS

Add mixtral-8x7b-instruct-v0.1.Q5_0.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a 7 months ago
mixtral-8x7b-instruct-v0.1.Q5_K_M.llamafile
32.2 GB
LFS

Add mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a 7 months ago
mixtral-8x7b-instruct-v0.1.Q6_K.llamafile
38.4 GB
LFS

Add mixtral-8x7b-instruct-v0.1.Q6_K.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a 7 months ago