Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
WizardLM-2-8x22B-GGUF
like
125
Text Generation
Transformers
GGUF
Safetensors
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mistral
arxiv:2304.12244
arxiv:2306.08568
arxiv:2308.09583
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
15
Train
Deploy
Use this model
refs/pr/1
WizardLM-2-8x22B-GGUF
1 contributor
History:
6 commits
MaziyarPanahi
5d5dbcf6702c60ff3b7fba7f1b429529732289689c858c69feac25fa82bb3a65
75cd4f5
verified
8 months ago
.gitattributes
Safe
1.91 kB
5d5dbcf6702c60ff3b7fba7f1b429529732289689c858c69feac25fa82bb3a65
8 months ago
WizardLM-2-8x22B.Q2_K-00001-of-00005.gguf
Safe
11.8 GB
LFS
bc69f1b19f22afb9fb22e9155ee9ad626d7efaf83b3732b4cf688e683e608acf
8 months ago
WizardLM-2-8x22B.Q2_K-00002-of-00005.gguf
Safe
12.3 GB
LFS
f4893524b07c0ef52917e08e4bab1d4b372d108fdf6e45fda557676364dc1845
8 months ago
WizardLM-2-8x22B.Q2_K-00003-of-00005.gguf
Safe
11.2 GB
LFS
f3e002d75fab11e80d07efc6f367ba511fe7d59b68f17a33a94338c2231b831d
8 months ago
WizardLM-2-8x22B.Q2_K-00004-of-00005.gguf
Safe
12 GB
LFS
76b243f920f399c07982d03149ac530d08f144380e8f2c4b6744778fb91a8d92
8 months ago
WizardLM-2-8x22B.Q2_K-00005-of-00005.gguf
Safe
4.79 GB
LFS
5d5dbcf6702c60ff3b7fba7f1b429529732289689c858c69feac25fa82bb3a65
8 months ago
