Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Mixtral-8x22B-v0.1-GGUF
like
73
Text Generation
Transformers
GGUF
5 languages
mixtral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
Mixture of Experts
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
33
Train
Deploy
Use this model
refs/pr/7
Mixtral-8x22B-v0.1-GGUF
1 contributor
History:
16 commits
MaziyarPanahi
c5539c71ba7cc0b09e25d13f186ae59625ed0466c1ed0f120dc43438822766af
afb3ade
verified
4 months ago
.gitattributes
2.89 kB
c5539c71ba7cc0b09e25d13f186ae59625ed0466c1ed0f120dc43438822766af
4 months ago
Mixtral-8x22B-v0.1.IQ3_XS-00001-of-00005.gguf
13.5 GB
LFS
[WIP] Upload folder using huggingface_hub (multi-commit a7d29cf8fce6f97c36cfa98fd4f8a3824343190b9841d2952acd2c67d92121f6) (#6)
4 months ago
Mixtral-8x22B-v0.1.IQ3_XS-00002-of-00005.gguf
13.5 GB
LFS
e8ee571b6585b364505184707961452bc8be610ea6f88bc00a3217bcc0f42080
4 months ago
Mixtral-8x22B-v0.1.IQ3_XS-00003-of-00005.gguf
12.3 GB
LFS
0f321ef105527a8c24a541dec46583c0738d062fb25885aac78e9c5cee5b2695
4 months ago
Mixtral-8x22B-v0.1.IQ3_XS-00004-of-00005.gguf
13.3 GB
LFS
fd3207506141b838d7023af3a7989048b36ba105a2a77bd03af1fc431ad81c36
4 months ago
Mixtral-8x22B-v0.1.IQ3_XS-00005-of-00005.gguf
5.61 GB
LFS
68c12c5cf8eff8f6ee25f5d401b8054d3ac5554a02e087e9e43cd8fffa60994e
4 months ago
Mixtral-8x22B-v0.1.Q2_K-00001-of-00005.gguf
11.8 GB
LFS
2833783d6145c1b4d4c5e47cbef51c6d3fcec42f1882a2548f7af0cc62dba9a6
4 months ago
Mixtral-8x22B-v0.1.Q2_K-00002-of-00005.gguf
12.3 GB
LFS
db346e8bfe96085888024646af53bcc8328a61f22662123e6cb306fe1b81a89f
4 months ago
Mixtral-8x22B-v0.1.Q2_K-00003-of-00005.gguf
11.2 GB
LFS
743c1660087c2b2fbd9b673a0a8bcb3b0aea8867d7cb992ff9180145a7a523e1
4 months ago
Mixtral-8x22B-v0.1.Q2_K-00004-of-00005.gguf
12 GB
LFS
073ffab4f9e10a5fabe3488a4fa5fb42b4b7917e14b93fbbec22c22edcef9cf3
4 months ago
Mixtral-8x22B-v0.1.Q2_K-00005-of-00005.gguf
4.79 GB
LFS
c5539c71ba7cc0b09e25d13f186ae59625ed0466c1ed0f120dc43438822766af
4 months ago
Mixtral-8x22B-v0.1.fp16-00001-of-00007.gguf
45.5 GB
LFS
Upload folder using huggingface_hub (#4)
4 months ago
Mixtral-8x22B-v0.1.fp16-00002-of-00007.gguf
45.1 GB
LFS
Upload folder using huggingface_hub (#4)
4 months ago
Mixtral-8x22B-v0.1.fp16-00003-of-00007.gguf
45.1 GB
LFS
Upload folder using huggingface_hub (#4)
4 months ago
Mixtral-8x22B-v0.1.fp16-00004-of-00007.gguf
45.1 GB
LFS
Upload folder using huggingface_hub (#4)
4 months ago
Mixtral-8x22B-v0.1.fp16-00005-of-00007.gguf
45.1 GB
LFS
Upload folder using huggingface_hub (#4)
4 months ago
Mixtral-8x22B-v0.1.fp16-00006-of-00007.gguf
45.1 GB
LFS
Upload folder using huggingface_hub (#4)
4 months ago
Mixtral-8x22B-v0.1.fp16-00007-of-00007.gguf
10.4 GB
LFS
Upload folder using huggingface_hub (#4)
4 months ago
README.md
8.8 kB
Update README.md (#5)
4 months ago
config.json
749 Bytes
Upload config.json (#2)
4 months ago
