Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q5_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.3 Q5_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.2 F16

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.2 Q8_0

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.2 Q5_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 F16

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q8_0

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_K_S

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_K_S

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q3_K_L

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q3_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q3_K_S

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q2_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_1

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_0

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_1

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q6_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 BF16

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 F16

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q8_0

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_0

Delete mistral-7b-instruct-v0.2.Q5_K.llamafile

Delete mistral-7b-instruct-v0.2.Q4_K.llamafile

Delete mistral-7b-instruct-v0.2.Q3_K.llamafile

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q6_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_K_S

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_K_S

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K_L

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K_S

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q2_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_1

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_0

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_1

Update README.md

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 BF16

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 F16

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q8_0

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_0

Quantize Mistral using llama.cpp PR #6412

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_S

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K