Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
PrunaAI
/
WizardLM-2-7B-GGUF-smashed
like
3
Follow
Pruna AI
105
GGUF
pruna-ai
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
2
Deploy
Use this model
1f687e0
WizardLM-2-7B-GGUF-smashed
2 contributors
History:
16 commits
johnrachwanpruna
030d19120f313b86974b7b31f5fcdaa07d0d7f0faaa8267ed724d1c5ce423e7c
1f687e0
verified
7 months ago
.gitattributes
2.59 kB
030d19120f313b86974b7b31f5fcdaa07d0d7f0faaa8267ed724d1c5ce423e7c
7 months ago
microsoft_WizardLM-2-7B.IQ3_M.gguf
3.28 GB
LFS
2befca1a07a468f9063e9e08006cc0bc30e50a68b2d4df1f8e230fbd513f2d5a
7 months ago
microsoft_WizardLM-2-7B.IQ3_S.gguf
3.18 GB
LFS
8cfb4d9750250c32899be0f313134ec784a40f04f1553258b43f4be878389f75
7 months ago
microsoft_WizardLM-2-7B.IQ3_XS.gguf
3.02 GB
LFS
1d5414afc699c11b8f02a4c98b1517ef6172d556a2be7faa9d2882771e42c4e1
7 months ago
microsoft_WizardLM-2-7B.IQ4_NL.gguf
4.16 GB
LFS
9b5fbb4db7cfd24c38977ff618123ebb9b3e33a7936dd61a287d8e823c28c503
7 months ago
microsoft_WizardLM-2-7B.IQ4_XS.gguf
3.94 GB
LFS
98d6c0af735e9ac9f89bebd7f4aea3bc65f26a010ccd6c67114a72c00eba9521
7 months ago
microsoft_WizardLM-2-7B.Q2_K.gguf
2.72 GB
LFS
63a863c48dda84756120d7a432686bdf58ab787851d415e2ec9263d3afc141a7
7 months ago
microsoft_WizardLM-2-7B.Q3_K_L.gguf
3.82 GB
LFS
2da95da32d278f7c1627d8c690050c16443091993e44c2c0b9c7ae7a821ee5aa
7 months ago
microsoft_WizardLM-2-7B.Q3_K_M.gguf
3.52 GB
LFS
ff8430e6875a9fd1fcc06124aa8e85ecff5c4ffacc355ce9de52ba08d6a4433c
7 months ago
microsoft_WizardLM-2-7B.Q3_K_S.gguf
3.16 GB
LFS
2ee10ca3c80c22ae0d67dadcff23f93d5e9a80c755784a11b3f30f6864b68557
7 months ago
microsoft_WizardLM-2-7B.Q4_0.gguf
4.11 GB
LFS
ba14a0ce99906cbd2fd9400537e401edc30a62440f46d302325ef21ddbff9494
7 months ago
microsoft_WizardLM-2-7B.Q4_1.gguf
4.55 GB
LFS
2dc167d2ca11632cb3672c4cc5ed8ba2dd9cc27feb93d02c751d4eb7f3b0501c
7 months ago
microsoft_WizardLM-2-7B.Q4_K_M.gguf
4.37 GB
LFS
447d974b332b9d43b8c9d7e0a954741aed42dc0ffb16da2a77afa4274b6b3384
7 months ago
microsoft_WizardLM-2-7B.Q4_K_S.gguf
4.14 GB
LFS
fd92ba04089d33b10c35605a2bcd358f589ef2989b00d388da0331702e0b4347
7 months ago
microsoft_WizardLM-2-7B.Q5_0.gguf
5 GB
LFS
8837fe5e157027c56258d65dfd42529f2516b53e2a080112ac0c3709bdf96bb7
7 months ago
microsoft_WizardLM-2-7B.Q5_1.gguf
5.44 GB
LFS
030d19120f313b86974b7b31f5fcdaa07d0d7f0faaa8267ed724d1c5ce423e7c
7 months ago