Transformers
llamafile
mixtral

Commit History

Quantize Q5_K_S with llamafile-0.8.5
f6c08d5
verified

jartine commited on

Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 BF16
3010772
verified

jartine commited on

Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 BF16
5ee9445
verified

jartine commited on

Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 F16
8c21d0b
verified

jartine commited on

Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 F16
9f10d3e
verified

jartine commited on

Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q3_K_S
5f8e853
verified

jartine commited on

Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q4_1
18d5826
verified

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q8_0.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a
437f800

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q6_K.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a
40eb574

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a
cec6a20

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q5_0.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a
f7552a9

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q4_K_M.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a
7638a3a

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q4_0.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a
efb2ef6

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q3_K_M.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a
36dcd62

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q2_K.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a
09c84bb

jartine commited on

Add .gitattributes to repo
d21ec33

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q2_K.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a
2524b82

jartine commited on

Add .gitattributes to repo
71973b5

jartine commited on

initial commit
321e34a

jartine commited on