Models
Datasets
Spaces
Posts
Docs
Pricing
Log In
Sign Up

MaziyarPanahi
/

Mixtral-8x22B-v0.1-GGUF

Text Generation

4-bit precision

8-bit precision

Mixture of Experts

text-generation-inference

Model card Files Files and versions Community

Mixtral-8x22B-v0.1-GGUF

1 contributor

History: 17 commits

MaziyarPanahi's picture

minor fix

096f9f2 verified 4 months ago

.gitattributes

5.74 kB

Update .gitattributes (#16) 4 months ago
Mixtral-8x22B-v0.1.IQ3_XS-00001-of-00005.gguf
13.5 GB
LFS

[WIP] Upload folder using huggingface_hub (multi-commit a7d29cf8fce6f97c36cfa98fd4f8a3824343190b9841d2952acd2c67d92121f6) (#6) 4 months ago
Mixtral-8x22B-v0.1.IQ3_XS-00002-of-00005.gguf
13.5 GB
LFS

Upload folder using huggingface_hub (#7) 4 months ago
Mixtral-8x22B-v0.1.IQ3_XS-00003-of-00005.gguf
12.3 GB
LFS

Upload folder using huggingface_hub (#7) 4 months ago
Mixtral-8x22B-v0.1.IQ3_XS-00004-of-00005.gguf
13.3 GB
LFS

Upload folder using huggingface_hub (#7) 4 months ago
Mixtral-8x22B-v0.1.IQ3_XS-00005-of-00005.gguf
5.61 GB
LFS

Upload folder using huggingface_hub (#7) 4 months ago
Mixtral-8x22B-v0.1.IQ4_XS-00001-of-00005.gguf
18 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.IQ4_XS-00002-of-00005.gguf
17.8 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.IQ4_XS-00003-of-00005.gguf
16.2 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.IQ4_XS-00004-of-00005.gguf
17.4 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.IQ4_XS-00005-of-00005.gguf
6.87 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q2_K-00001-of-00005.gguf
11.8 GB
LFS

Upload folder using huggingface_hub (#7) 4 months ago
Mixtral-8x22B-v0.1.Q2_K-00002-of-00005.gguf
12.3 GB
LFS

Upload folder using huggingface_hub (#7) 4 months ago
Mixtral-8x22B-v0.1.Q2_K-00003-of-00005.gguf
11.2 GB
LFS

Upload folder using huggingface_hub (#7) 4 months ago
Mixtral-8x22B-v0.1.Q2_K-00004-of-00005.gguf
12 GB
LFS

Upload folder using huggingface_hub (#7) 4 months ago
Mixtral-8x22B-v0.1.Q2_K-00005-of-00005.gguf
4.79 GB
LFS

Upload folder using huggingface_hub (#7) 4 months ago
Mixtral-8x22B-v0.1.Q3_K_L-00001-of-00005.gguf
16.5 GB
LFS

Upload folder using huggingface_hub (#8) 4 months ago
Mixtral-8x22B-v0.1.Q3_K_L-00002-of-00005.gguf
17.1 GB
LFS

Upload folder using huggingface_hub (#8) 4 months ago
Mixtral-8x22B-v0.1.Q3_K_L-00003-of-00005.gguf
15.6 GB
LFS

Upload folder using huggingface_hub (#8) 4 months ago
Mixtral-8x22B-v0.1.Q3_K_L-00004-of-00005.gguf
16.8 GB
LFS

Upload folder using huggingface_hub (#8) 4 months ago
Mixtral-8x22B-v0.1.Q3_K_L-00005-of-00005.gguf
6.61 GB
LFS

Upload folder using huggingface_hub (#8) 4 months ago
Mixtral-8x22B-v0.1.Q3_K_M-00001-of-00005.gguf
15.7 GB
LFS

Upload folder using huggingface_hub (#8) 4 months ago
Mixtral-8x22B-v0.1.Q3_K_M-00002-of-00005.gguf
15.9 GB
LFS

Upload folder using huggingface_hub (#8) 4 months ago
Mixtral-8x22B-v0.1.Q3_K_M-00003-of-00005.gguf
14.5 GB
LFS

Upload folder using huggingface_hub (#8) 4 months ago
Mixtral-8x22B-v0.1.Q3_K_M-00004-of-00005.gguf
15.6 GB
LFS

Upload folder using huggingface_hub (#8) 4 months ago
Mixtral-8x22B-v0.1.Q3_K_M-00005-of-00005.gguf
6.16 GB
LFS

Upload folder using huggingface_hub (#8) 4 months ago
Mixtral-8x22B-v0.1.Q3_K_S-00001-of-00005.gguf
14 GB
LFS

Upload folder using huggingface_hub (#8) 4 months ago
Mixtral-8x22B-v0.1.Q3_K_S-00002-of-00005.gguf
14.5 GB
LFS

Upload folder using huggingface_hub (#8) 4 months ago
Mixtral-8x22B-v0.1.Q3_K_S-00003-of-00005.gguf
13.2 GB
LFS

Upload folder using huggingface_hub (#8) 4 months ago
Mixtral-8x22B-v0.1.Q3_K_S-00004-of-00005.gguf
14.2 GB
LFS

Upload folder using huggingface_hub (#8) 4 months ago
Mixtral-8x22B-v0.1.Q3_K_S-00005-of-00005.gguf
5.62 GB
LFS

Upload folder using huggingface_hub (#8) 4 months ago
Mixtral-8x22B-v0.1.Q4_K_M-00001-of-00005.gguf
20 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q4_K_M-00002-of-00005.gguf
19.7 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q4_K_M-00003-of-00005.gguf
17.9 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q4_K_M-00004-of-00005.gguf
19.7 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q4_K_M-00005-of-00005.gguf
8.29 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q4_K_S-00001-of-00005.gguf
18.8 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q4_K_S-00002-of-00005.gguf
18.9 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q4_K_S-00003-of-00005.gguf
17.1 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q4_K_S-00004-of-00005.gguf
18.4 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q4_K_S-00005-of-00005.gguf
7.25 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q5_K_M-00001-of-00005.gguf
23 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q5_K_M-00002-of-00005.gguf
23.4 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q5_K_M-00003-of-00005.gguf
21.2 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q5_K_M-00004-of-00005.gguf
23.1 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q5_K_M-00005-of-00005.gguf
9.32 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q5_K_S-00001-of-00005.gguf
22 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q5_K_S-00002-of-00005.gguf
23 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q5_K_S-00003-of-00005.gguf
20.8 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago
Mixtral-8x22B-v0.1.Q5_K_S-00004-of-00005.gguf
22.4 GB
LFS

Upload folder using huggingface_hub (#13) 4 months ago