Hugging Face's logo

MaziyarPanahi
/
Mixtral-8x22B-v0.1-GGUF

Text Generation
Transformers
GGUF
5 languages
mixtral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
Mixture of Experts
text-generation-inference
Model card Files Community
33

Upload folder using huggingface_hub

#7
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/7
Discussion Files changed
+36
-0
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. Mixtral-8x22B-v0.1.IQ3_XS-00002-of-00005.gguf +3 -0
  3. Mixtral-8x22B-v0.1.IQ3_XS-00003-of-00005.gguf +3 -0
  4. Mixtral-8x22B-v0.1.IQ3_XS-00004-of-00005.gguf +3 -0
  5. Mixtral-8x22B-v0.1.IQ3_XS-00005-of-00005.gguf +3 -0
  6. Mixtral-8x22B-v0.1.Q2_K-00001-of-00005.gguf +3 -0
  7. Mixtral-8x22B-v0.1.Q2_K-00002-of-00005.gguf +3 -0
  8. Mixtral-8x22B-v0.1.Q2_K-00003-of-00005.gguf +3 -0
  9. Mixtral-8x22B-v0.1.Q2_K-00004-of-00005.gguf +3 -0
  10. Mixtral-8x22B-v0.1.Q2_K-00005-of-00005.gguf +3 -0
.gitattributes CHANGED
@@ -41,3 +41,12 @@ Mixtral-8x22B-v0.1.fp16-00005-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
41
  Mixtral-8x22B-v0.1.fp16-00006-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
42
  Mixtral-8x22B-v0.1.fp16-00007-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
43
  Mixtral-8x22B-v0.1.IQ3_XS-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
41
  Mixtral-8x22B-v0.1.fp16-00006-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
42
  Mixtral-8x22B-v0.1.fp16-00007-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
43
  Mixtral-8x22B-v0.1.IQ3_XS-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Mixtral-8x22B-v0.1.IQ3_XS-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Mixtral-8x22B-v0.1.IQ3_XS-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Mixtral-8x22B-v0.1.IQ3_XS-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Mixtral-8x22B-v0.1.IQ3_XS-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Mixtral-8x22B-v0.1.Q2_K-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Mixtral-8x22B-v0.1.Q2_K-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Mixtral-8x22B-v0.1.Q2_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Mixtral-8x22B-v0.1.Q2_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Mixtral-8x22B-v0.1.Q2_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Mixtral-8x22B-v0.1.IQ3_XS-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c99a4cb2b1365b52f067a9555335aa0e1ffe0e53ba51d154ef9e5feef46161da
3
+ size 13483630784
Mixtral-8x22B-v0.1.IQ3_XS-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:efce33e4670050bb3c487f70d8f94d9d94d432060c98c598efde72b17624412e
3
+ size 12270264448
Mixtral-8x22B-v0.1.IQ3_XS-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a6e25e20aaf4142efaff83075db24446eaa539c70177201b2690e3a5f74df84a
3
+ size 13339615392
Mixtral-8x22B-v0.1.IQ3_XS-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91b2eaf3710f06fb68e8b39c0f0e2aac25a74040254b685e48baf47f5139b45a
3
+ size 5614673216
Mixtral-8x22B-v0.1.Q2_K-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8df57105771bcdb84e12ead7bb878f1bf1bb6b4bc7559ee28dc94b59849480c0
3
+ size 11843728352
Mixtral-8x22B-v0.1.Q2_K-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6789b187d6a46603dc003ea64a0fbe1f9e8a5c98235e0f7e7b57dea3583496c
3
+ size 12267708608
Mixtral-8x22B-v0.1.Q2_K-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d82bd120f482f850e3637f9c5dae991c6f8944cbce46b899ee7c2886bf9d0e1
3
+ size 11188527232
Mixtral-8x22B-v0.1.Q2_K-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a46084f740321c8aa44faee95a93373098921f41ef47bf6679b83458dd16dad4
3
+ size 12016738464
Mixtral-8x22B-v0.1.Q2_K-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee8b387d29377f9ce22d41b2cd9075eeb573a484bbbec403d28d0edaf248f87f
3
+ size 4786462016