Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Mixtral-8x22B-v0.1-GGUF
like
73
Text Generation
Transformers
GGUF
5 languages
mixtral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
Mixture of Experts
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
33
Train
Deploy
Use this model
381def4
Mixtral-8x22B-v0.1-GGUF
1 contributor
History:
16 commits
MaziyarPanahi
5568cba51835526c97541bedb25be55a965a06a3462ac7d5d9032f9912f05c17
381def4
verified
3 months ago
.gitattributes
2.98 kB
5568cba51835526c97541bedb25be55a965a06a3462ac7d5d9032f9912f05c17
3 months ago
Mixtral-8x22B-v0.1.IQ3_XS-00001-of-00005.gguf
13.5 GB
LFS
[WIP] Upload folder using huggingface_hub (multi-commit a7d29cf8fce6f97c36cfa98fd4f8a3824343190b9841d2952acd2c67d92121f6) (#6)
3 months ago
Mixtral-8x22B-v0.1.Q3_K_L-00001-of-00005.gguf
16.5 GB
LFS
c3c7745af3c35f5b7c17bcec931731a703a633e77bfbc8a611a882dc1ea3969f
3 months ago
Mixtral-8x22B-v0.1.Q3_K_L-00002-of-00005.gguf
17.1 GB
LFS
4a21f390d007ae827e11302feab8d61bb6f1dbc3ae38c4c53a9e0d23c2fd27c9
3 months ago
Mixtral-8x22B-v0.1.Q3_K_L-00003-of-00005.gguf
15.6 GB
LFS
7c1011e05f72847ce026b9394ca61b68c76e7936323c1dfd633748428ea3279e
3 months ago
Mixtral-8x22B-v0.1.Q3_K_L-00004-of-00005.gguf
16.8 GB
LFS
35ed9df91432b99d0b72971816dd7974e855b2f5ce8687c92fd6ee98d26186d3
3 months ago
Mixtral-8x22B-v0.1.Q3_K_L-00005-of-00005.gguf
6.61 GB
LFS
444001b8700cb7ac99fef144a6b20f9bedd32bf00467582340dfaa8f5d8e680e
3 months ago
Mixtral-8x22B-v0.1.Q3_K_M-00001-of-00005.gguf
15.7 GB
LFS
495522a686e28ba012dd6e745efeebc2c0070c62c2a58e752cade0ee64a8c11d
3 months ago
Mixtral-8x22B-v0.1.Q3_K_M-00002-of-00005.gguf
15.9 GB
LFS
8571db4546d811517e0a66859489e32e53b0590e9b56d457acf49e59f7590a7a
3 months ago
Mixtral-8x22B-v0.1.Q3_K_M-00003-of-00005.gguf
14.5 GB
LFS
b8edb1d60850bce15eb98a4eb07b14a94a4f689dbd5c7ebec06307722dd9aec8
3 months ago
Mixtral-8x22B-v0.1.Q3_K_M-00004-of-00005.gguf
15.6 GB
LFS
df1dfa2c47996dad0a59854172db7277e60dd940306b71d6d2f45e6b8adaa510
3 months ago
Mixtral-8x22B-v0.1.Q3_K_M-00005-of-00005.gguf
6.16 GB
LFS
5568cba51835526c97541bedb25be55a965a06a3462ac7d5d9032f9912f05c17
3 months ago
Mixtral-8x22B-v0.1.fp16-00001-of-00007.gguf
45.5 GB
LFS
Upload folder using huggingface_hub (#4)
3 months ago
Mixtral-8x22B-v0.1.fp16-00002-of-00007.gguf
45.1 GB
LFS
Upload folder using huggingface_hub (#4)
3 months ago
Mixtral-8x22B-v0.1.fp16-00003-of-00007.gguf
45.1 GB
LFS
Upload folder using huggingface_hub (#4)
3 months ago
Mixtral-8x22B-v0.1.fp16-00004-of-00007.gguf
45.1 GB
LFS
Upload folder using huggingface_hub (#4)
3 months ago
Mixtral-8x22B-v0.1.fp16-00005-of-00007.gguf
45.1 GB
LFS
Upload folder using huggingface_hub (#4)
3 months ago
Mixtral-8x22B-v0.1.fp16-00006-of-00007.gguf
45.1 GB
LFS
Upload folder using huggingface_hub (#4)
3 months ago
Mixtral-8x22B-v0.1.fp16-00007-of-00007.gguf
10.4 GB
LFS
Upload folder using huggingface_hub (#4)
3 months ago
README.md
8.8 kB
Update README.md (#5)
3 months ago
config.json
749 Bytes
Upload config.json (#2)
3 months ago
