Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
PrunaAI
/
Mistral-22B-v0.2-GGUF-smashed
like
3
Follow
Pruna AI
114
GGUF
pruna-ai
Inference Endpoints
Model card
Files
Files and versions
Community
1
Deploy
Use this model
fc6023a
Mistral-22B-v0.2-GGUF-smashed
2 contributors
History:
20 commits
johnrachwanpruna
a63e4d936bc868f67ea5c4d9096b735878a9f547d6821d5d64e4278b73f8ba32
fc6023a
verified
7 months ago
.gitattributes
Safe
2.74 kB
a63e4d936bc868f67ea5c4d9096b735878a9f547d6821d5d64e4278b73f8ba32
7 months ago
Mistral-22B-v0.2.IQ3_M.gguf
Safe
10.1 GB
LFS
f1f48864359b65ca488c768aea4bd3479ee0b326b719693a983db5cedd50842a
7 months ago
Mistral-22B-v0.2.IQ3_S.gguf
Safe
9.68 GB
LFS
a1442c07676f7da92126ab50bd5726d93303932547ed35afe5fb2a82962b6a09
7 months ago
Mistral-22B-v0.2.IQ3_XS.gguf
Safe
9.17 GB
LFS
1cdbb1a4be73d0565c9acdf706ae29384db8b21d2fb70bb21fbd78cb50449132
7 months ago
Mistral-22B-v0.2.IQ4_NL.gguf
Safe
12.7 GB
LFS
44e487d0eeb773698f06f4a24b2c327454e15fe834ced885f2248ad26de52802
7 months ago
Mistral-22B-v0.2.IQ4_XS.gguf
Safe
12 GB
LFS
63f82fa2f8bf418c4442d476bdd5cbbdc9ae46b1c2579b5c2e4ff85fce317f07
7 months ago
Mistral-22B-v0.2.Q2_K.gguf
Safe
8.27 GB
LFS
115f2f7133572b1e7a7ad504a74f15d70bd09cbff2c2466d25bb84b42407d513
7 months ago
Mistral-22B-v0.2.Q3_K_L.gguf
Safe
11.7 GB
LFS
51975ebf47753bc7cc4304b051f7af0406d552a124e87b71bb22420cf3d6d968
7 months ago
Mistral-22B-v0.2.Q3_K_M.gguf
Safe
10.8 GB
LFS
0981fdeb8ad9e2182cefbc8cdec00782af5e90f3a999e2b5c45e1232140860e7
7 months ago
Mistral-22B-v0.2.Q3_K_S.gguf
Safe
9.64 GB
LFS
29bab55020004934f2391c47a4a541a080e28d773042ee3818adf5b85f138104
7 months ago
Mistral-22B-v0.2.Q4_0.gguf
Safe
12.6 GB
LFS
ed5929fead7ed1eb4dcd06dba405b05313147fb9735ea5607682b4533a3d1357
7 months ago
Mistral-22B-v0.2.Q4_1.gguf
Safe
13.9 GB
LFS
f1a3f0ca2f2bcaa1b991ded7e6d4d4499b09312b47e76a1df61cf4361ccb45dc
7 months ago
Mistral-22B-v0.2.Q4_K_M.gguf
Safe
13.3 GB
LFS
8d861b9d8aab5e63649677a56b58cc612ce8f3f2fd30507e1d3c5802da55c31c
7 months ago
Mistral-22B-v0.2.Q4_K_S.gguf
Safe
12.7 GB
LFS
c17e1d64a10f39dbbcde2fed5f2cf7045d199707a42205a0929f367e8367e961
7 months ago
Mistral-22B-v0.2.Q5_0.gguf
Safe
15.3 GB
LFS
fd2234849bfc5c50bbf7ee28bdb05f2cf36699611bbbdea36f77f0083174041e
7 months ago
Mistral-22B-v0.2.Q5_1.gguf
Safe
16.7 GB
LFS
09bc5dc6996b6366909675c4fa973f3e7bc179083bac1626e5f704ce6bd7085b
7 months ago
Mistral-22B-v0.2.Q5_K_M.gguf
Safe
15.7 GB
LFS
4b3f0a0fa65b1bd071889bcdcdd02f2439f11e4eaa41629f3ab4c34ac454aea9
7 months ago
Mistral-22B-v0.2.Q5_K_S.gguf
Safe
15.3 GB
LFS
254e40fec29c617f09b697254af9924a25ad0b1b93294754630ac02cea6343ac
7 months ago
Mistral-22B-v0.2.Q6_K.gguf
Safe
18.2 GB
LFS
622c3a774c29862fe9114fc652c2e83756dc4808434e6a1965ced7e5e6b139e1
7 months ago
Mistral-22B-v0.2.Q8_0.gguf
Safe
23.6 GB
LFS
a63e4d936bc868f67ea5c4d9096b735878a9f547d6821d5d64e4278b73f8ba32
7 months ago