Hugging Face's logo

Mozilla
/
Mistral-7B-Instruct-v0.2-llamafile

Text Generation
Transformers
GGUF
llamafile
mistral
finetuned
conversational
Model card Files Community
1
Mistral-7B-Instruct-v0.2-llamafile

Commit History

Update README.md
c49fd32
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 BF16
4432405
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 F16
e3cd3f3
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q8_0
3cff2b7
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_K_M
57b9574
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_0
98328f7
verified

jartine commited on

Quantize Mistral using llama.cpp PR #6412
1b7651d
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_S
04f6b23
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K
9cb5c75
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_M
48a6160
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 F16
fe448e3
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 BF16
585c23f
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q8_0
51a9579
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q6_K
33f6022
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_M
f8f92c5
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_S
c9b8a87
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K
0348a03
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_K_M
8ca85dc
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_K_S
9cec5f6
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_K
7dd9c2f
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q3_K_L
6469062
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q3_K_M
7aee2e0
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q3_K_S
4984a8d
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q3_K
e20d532
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q2_K
c94d035
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_1
6f8748b
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_0
44f8fbe
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_1
817c085
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_0
a56fd92
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q8_0.gguf with llamafile v0.6.2
0dfcfb1
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q6_K.gguf with llamafile v0.6.2
ca1fbc2
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q5_K_S.gguf with llamafile v0.6.2
57744ed
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q5_K_M.gguf with llamafile v0.6.2
cd2a8af
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q5_0.gguf with llamafile v0.6.2
1a4f44d
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q4_K_S.gguf with llamafile v0.6.2
814b17b
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q4_K_M.gguf with llamafile v0.6.2
3b1f393
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q4_0.gguf with llamafile v0.6.2
acc4c07
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q3_K_S.gguf with llamafile v0.6.2
aff84a5
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q3_K_M.gguf with llamafile v0.6.2
44957db
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q3_K_L.gguf with llamafile v0.6.2
615457d
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q2_K.gguf with llamafile v0.6.2
6682493
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q8_0.gguf with llamafile v0.6.1
173ebe6
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q6_K.gguf with llamafile v0.6.1
8d44d1f
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q5_K_S.gguf with llamafile v0.6.1
0b11499
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q5_K_M.gguf with llamafile v0.6.1
3bc2436
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q5_0.gguf with llamafile v0.6.1
2c66462
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q4_K_S.gguf with llamafile v0.6.1
723fe2e
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q4_K_M.gguf with llamafile v0.6.1
a227c19
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q4_0.gguf with llamafile v0.6.1
b5c92e4
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q3_K_S.gguf with llamafile v0.6.1
87cdd84
verified

jartine commited on