Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 F16

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q8_0

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_0

Quantize Mistral using llama.cpp PR #6412

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_S

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 F16

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 BF16

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q8_0

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q6_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_S

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_K_S

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q3_K_L

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q3_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q3_K_S

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q3_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q2_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_1

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_0

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_1

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_0

Wrap mistral-7b-instruct-v0.2.Q8_0.gguf with llamafile v0.6.2

Wrap mistral-7b-instruct-v0.2.Q6_K.gguf with llamafile v0.6.2

Wrap mistral-7b-instruct-v0.2.Q5_K_S.gguf with llamafile v0.6.2

Wrap mistral-7b-instruct-v0.2.Q5_K_M.gguf with llamafile v0.6.2

Wrap mistral-7b-instruct-v0.2.Q5_0.gguf with llamafile v0.6.2

Wrap mistral-7b-instruct-v0.2.Q4_K_S.gguf with llamafile v0.6.2

Wrap mistral-7b-instruct-v0.2.Q4_K_M.gguf with llamafile v0.6.2

Wrap mistral-7b-instruct-v0.2.Q4_0.gguf with llamafile v0.6.2

Wrap mistral-7b-instruct-v0.2.Q3_K_S.gguf with llamafile v0.6.2

Wrap mistral-7b-instruct-v0.2.Q3_K_M.gguf with llamafile v0.6.2

Wrap mistral-7b-instruct-v0.2.Q3_K_L.gguf with llamafile v0.6.2

Wrap mistral-7b-instruct-v0.2.Q2_K.gguf with llamafile v0.6.2

Wrap mistral-7b-instruct-v0.2.Q8_0.gguf with llamafile v0.6.1

Wrap mistral-7b-instruct-v0.2.Q6_K.gguf with llamafile v0.6.1

Wrap mistral-7b-instruct-v0.2.Q5_K_S.gguf with llamafile v0.6.1

Wrap mistral-7b-instruct-v0.2.Q5_K_M.gguf with llamafile v0.6.1

Wrap mistral-7b-instruct-v0.2.Q5_0.gguf with llamafile v0.6.1

Wrap mistral-7b-instruct-v0.2.Q4_K_S.gguf with llamafile v0.6.1

Wrap mistral-7b-instruct-v0.2.Q4_K_M.gguf with llamafile v0.6.1

Wrap mistral-7b-instruct-v0.2.Q4_0.gguf with llamafile v0.6.1

Wrap mistral-7b-instruct-v0.2.Q3_K_S.gguf with llamafile v0.6.1

Wrap mistral-7b-instruct-v0.2.Q3_K_M.gguf with llamafile v0.6.1

Wrap mistral-7b-instruct-v0.2.Q3_K_L.gguf with llamafile v0.6.1