Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
PrunaAI
/
Mistral-7B-Instruct-v0.3-GGUF-smashed
like
0
GGUF
pruna-ai
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
1
Deploy
Use this model
0339ae6
Mistral-7B-Instruct-v0.3-GGUF-smashed
1 contributor
History:
10 commits
sharpenb
c8cca804b81fc9d7b469b6fc7d20934c0a9fd0fd0f1a1824c626eb3413f5c180
0339ae6
verified
5 months ago
.gitattributes
2.17 kB
c8cca804b81fc9d7b469b6fc7d20934c0a9fd0fd0f1a1824c626eb3413f5c180
5 months ago
Mistral-7B-Instruct-v0.3.Q2_K.gguf
2.72 GB
LFS
d9fc59a8b1243fc0e2ac5cc2fae5f829151ac87aecea899dc40556f2eba47528
5 months ago
Mistral-7B-Instruct-v0.3.Q3_K_L.gguf
3.83 GB
LFS
fd3475211664340ef7df78d57ab46a539b65307f87420b77f82c2481af3c1813
5 months ago
Mistral-7B-Instruct-v0.3.Q3_K_M.gguf
3.52 GB
LFS
ba23d333c55fceee25a0b69c3eb366016a606dba4b1ac42eebe5f178ca16f690
5 months ago
Mistral-7B-Instruct-v0.3.Q3_K_S.gguf
3.17 GB
LFS
cee92732cbba00d60583ecf568fa876289726036702c21b51a75cfb7fa5ad8a8
5 months ago
Mistral-7B-Instruct-v0.3.Q4_0.gguf
4.11 GB
LFS
d9f508a83a45107b4c460447ee1086bd12ce4a7f9e1db1a8c39cdc441d590b27
5 months ago
Mistral-7B-Instruct-v0.3.Q4_1.gguf
4.56 GB
LFS
f53f250d1150417fb233d8677b7e6a97eade220de0fc3cdec2515630d852d5ec
5 months ago
Mistral-7B-Instruct-v0.3.Q4_K_M.gguf
4.37 GB
LFS
cda131735595fab7f47352dadc2b2c2cb6b68f3bb1e0fed9fb9c9801a1ffb2b8
5 months ago
Mistral-7B-Instruct-v0.3.Q4_K_S.gguf
4.14 GB
LFS
ae17147d336a32f68f069932a8a229b4f6c278d72280041f37fb2bb8a3830dfd
5 months ago
Mistral-7B-Instruct-v0.3.Q5_0.gguf
5 GB
LFS
c8cca804b81fc9d7b469b6fc7d20934c0a9fd0fd0f1a1824c626eb3413f5c180
5 months ago