Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Mistral-Small-Instruct-2409-GGUF
like
2
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
Mistral-Small-Instruct-2409-GGUF
1 contributor
History:
18 commits
MaziyarPanahi
907797f952e6f222bd6736c71da95add21423af790573aa20f5d3b9b04348db5
92a6d5b
verified
2 months ago
.gitattributes
Safe
2.81 kB
907797f952e6f222bd6736c71da95add21423af790573aa20f5d3b9b04348db5
2 months ago
Mistral-Small-Instruct-2409-GGUF_imatrix.dat
11.9 MB
LFS
907797f952e6f222bd6736c71da95add21423af790573aa20f5d3b9b04348db5
2 months ago
Mistral-Small-Instruct-2409.IQ1_M.gguf
Safe
5.27 GB
LFS
d97ea4a1d42c3368b208cf06cec623e9f5fb03938a279c38612d1acde7244a27
2 months ago
Mistral-Small-Instruct-2409.IQ1_S.gguf
Safe
4.83 GB
LFS
07314d8a2b5323b9d045348b779f0f5c93de26113e9320c6a2c92a80725521ac
2 months ago
Mistral-Small-Instruct-2409.IQ2_XS.gguf
Safe
6.65 GB
LFS
4325ec2cd0579937e24513e09138db858b55a686e157f87f163f9ec0797ebefe
2 months ago
Mistral-Small-Instruct-2409.IQ3_XS.gguf
Safe
9.18 GB
LFS
c27c599ce30688e70283a911239259359932f5e4c2bfce54c4267fb92906764b
2 months ago
Mistral-Small-Instruct-2409.IQ4_XS.gguf
Safe
11.9 GB
LFS
038dbb9704e27e05422b0e62878c4cba5cc4bcf528c1c3ef6e2170de97836f79
2 months ago
Mistral-Small-Instruct-2409.Q2_K.gguf
Safe
8.27 GB
LFS
09c69d43845de7bc4d3f1bbb8910d69b03b2444e206c2a086ca7b8b28e406038
2 months ago
Mistral-Small-Instruct-2409.Q3_K_L.gguf
Safe
11.7 GB
LFS
d59c868477712071137f1d10f3aeac4411d8bdc386437159bffb1e377c8b2402
2 months ago
Mistral-Small-Instruct-2409.Q3_K_M.gguf
Safe
10.8 GB
LFS
f2de7ffd39aec8dddf94b1b9c86f45f93b738fff04db543ca05c64ce4ef1af44
2 months ago
Mistral-Small-Instruct-2409.Q3_K_S.gguf
Safe
9.64 GB
LFS
72058eebd438f4bc08ee3197c32530097a37e5db2fe8eb29dd3e0b283ed81117
2 months ago
Mistral-Small-Instruct-2409.Q4_K_M.gguf
Safe
13.3 GB
LFS
8690d7a32304278be77265f5e545764276b5ea5e42338cef35ae46bb1808d0ac
2 months ago
Mistral-Small-Instruct-2409.Q4_K_S.gguf
Safe
12.7 GB
LFS
43c4c03e63f03f320b5c319adbe9d22673fb4731b88e3eb34c3fbf71d604b5b6
2 months ago
Mistral-Small-Instruct-2409.Q5_K_M.gguf
Safe
15.7 GB
LFS
e4d076c506c9ff0d713a316209d4031be46387e5687bbd6ef0489e9d05dd29b4
2 months ago
Mistral-Small-Instruct-2409.Q5_K_S.gguf
Safe
15.3 GB
LFS
d133f4fd86e7d8452b2b226b1e753a8f9b42d3c4d2753b44fd03e1701660a7c3
2 months ago
Mistral-Small-Instruct-2409.Q6_K.gguf
Safe
18.3 GB
LFS
f16f70c3113e86a025e87e792028f8ec80c6a909ecbcf0d090c0d535cff39b59
2 months ago
Mistral-Small-Instruct-2409.Q8_0.gguf
Safe
23.6 GB
LFS
a7adc8824d32bab8aaac7cd4240b665218a36001e62491637265db20bc94f685
2 months ago
Mistral-Small-Instruct-2409.fp16.gguf
Safe
44.5 GB
LFS
bf245abaa5bc1fc36b0f4f179c3ee2f5b6e7f7cd8bcee9693aa52981d0322625
2 months ago
README.md
Safe
3.06 kB
907797f952e6f222bd6736c71da95add21423af790573aa20f5d3b9b04348db5
2 months ago
