Commit History

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 F16
297e980
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q8_0
19c6940
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_K_M
79f4750
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_K_S
ad8e3b6
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_K_M
c922489
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_K_S
3ca8321
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q3_K_L
02d32ed
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q3_K_M
4fa4b27
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q3_K_S
006ee39
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q2_K
276646b
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_1
3d77221
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_0
2af1104
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_1
8ac62df
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q6_K
4e7c685
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 BF16
8e26aea
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 F16
abdadf9
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q8_0
3839d84
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_K_M
c5fa3a5
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_0
556284a
verified

jartine commited on

Delete mistral-7b-instruct-v0.2.Q5_K.llamafile
75a59f0
verified

jartine commited on

Delete mistral-7b-instruct-v0.2.Q4_K.llamafile
8606e99
verified

jartine commited on

Delete mistral-7b-instruct-v0.2.Q3_K.llamafile
6caa989
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q6_K
72d92cc
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_K_S
09f2ae9
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_K
1a09948
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_K_M
2bcc43a
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_K_S
8c9a271
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_K
c255134
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K_L
54179e5
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K_M
9854006
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K_S
86ddc4e
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K
57412fc
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q2_K
0c51908
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_1
7fdbcb3
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_0
f51d687
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_1
2f4ad9d
verified

jartine commited on

Update README.md
c49fd32
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 BF16
4432405
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 F16
e3cd3f3
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q8_0
3cff2b7
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_K_M
57b9574
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_0
98328f7
verified

jartine commited on

Quantize Mistral using llama.cpp PR #6412
1b7651d
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_S
04f6b23
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K
9cb5c75
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_M
48a6160
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 F16
fe448e3
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 BF16
585c23f
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q8_0
51a9579
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q6_K
33f6022
verified

jartine commited on