Hugging Face's logo

MaziyarPanahi
/
Mixtral-8x22B-v0.1-GGUF

Text Generation
Transformers
GGUF
5 languages
mixtral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
Mixture of Experts
text-generation-inference
Model card Files Community
33
MaziyarPanahi commited on
Commit
f47ae36
•
1 Parent(s): 3db84fa

Upload folder using huggingface_hub (#7)

Browse files

- 163fed69466581a612841700d4e4f3226312a02b53c13f22b7a728d0c78f066a (7c1bf6e109393d347fe01af2d5be987e595380a2)
- e8ee571b6585b364505184707961452bc8be610ea6f88bc00a3217bcc0f42080 (370b3dbd1aa4d57e52a8ac6a962d50728d28a832)
- 0f321ef105527a8c24a541dec46583c0738d062fb25885aac78e9c5cee5b2695 (8a4a2ea79739e4eb25eaefdb0d5cb55cf9d3e05f)
- fd3207506141b838d7023af3a7989048b36ba105a2a77bd03af1fc431ad81c36 (b60f09708427fc589f0499c87e350ac65337540b)
- 68c12c5cf8eff8f6ee25f5d401b8054d3ac5554a02e087e9e43cd8fffa60994e (efdede4cc995a74351ba22c1e9e578c91575a1ec)
- 2833783d6145c1b4d4c5e47cbef51c6d3fcec42f1882a2548f7af0cc62dba9a6 (2072f4297fdb2fb1d6a98ea748bc8d25a0eaa632)
- db346e8bfe96085888024646af53bcc8328a61f22662123e6cb306fe1b81a89f (617ffd0d90d5dc492b97f0dad06b3cfe5a2baf55)
- 743c1660087c2b2fbd9b673a0a8bcb3b0aea8867d7cb992ff9180145a7a523e1 (3f70f4c8de98e6958624521e5a3d6be56b015b2f)
- 073ffab4f9e10a5fabe3488a4fa5fb42b4b7917e14b93fbbec22c22edcef9cf3 (2d8a5160e53f4f47c9a46fff1883a3b8594729de)
- c5539c71ba7cc0b09e25d13f186ae59625ed0466c1ed0f120dc43438822766af (afb3ade169327fa9e5e946a558339e7262696343)

Files changed (10) hide show
  1. .gitattributes +9 -0
  2. Mixtral-8x22B-v0.1.IQ3_XS-00002-of-00005.gguf +3 -0
  3. Mixtral-8x22B-v0.1.IQ3_XS-00003-of-00005.gguf +3 -0
  4. Mixtral-8x22B-v0.1.IQ3_XS-00004-of-00005.gguf +3 -0
  5. Mixtral-8x22B-v0.1.IQ3_XS-00005-of-00005.gguf +3 -0
  6. Mixtral-8x22B-v0.1.Q2_K-00001-of-00005.gguf +3 -0
  7. Mixtral-8x22B-v0.1.Q2_K-00002-of-00005.gguf +3 -0
  8. Mixtral-8x22B-v0.1.Q2_K-00003-of-00005.gguf +3 -0
  9. Mixtral-8x22B-v0.1.Q2_K-00004-of-00005.gguf +3 -0
  10. Mixtral-8x22B-v0.1.Q2_K-00005-of-00005.gguf +3 -0
.gitattributes CHANGED
@@ -41,3 +41,12 @@ Mixtral-8x22B-v0.1.fp16-00005-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
41
  Mixtral-8x22B-v0.1.fp16-00006-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
42
  Mixtral-8x22B-v0.1.fp16-00007-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
43
  Mixtral-8x22B-v0.1.IQ3_XS-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
41
  Mixtral-8x22B-v0.1.fp16-00006-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
42
  Mixtral-8x22B-v0.1.fp16-00007-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
43
  Mixtral-8x22B-v0.1.IQ3_XS-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Mixtral-8x22B-v0.1.IQ3_XS-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Mixtral-8x22B-v0.1.IQ3_XS-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Mixtral-8x22B-v0.1.IQ3_XS-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Mixtral-8x22B-v0.1.IQ3_XS-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Mixtral-8x22B-v0.1.Q2_K-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Mixtral-8x22B-v0.1.Q2_K-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Mixtral-8x22B-v0.1.Q2_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Mixtral-8x22B-v0.1.Q2_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Mixtral-8x22B-v0.1.Q2_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Mixtral-8x22B-v0.1.IQ3_XS-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c99a4cb2b1365b52f067a9555335aa0e1ffe0e53ba51d154ef9e5feef46161da
3
+ size 13483630784
Mixtral-8x22B-v0.1.IQ3_XS-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:efce33e4670050bb3c487f70d8f94d9d94d432060c98c598efde72b17624412e
3
+ size 12270264448
Mixtral-8x22B-v0.1.IQ3_XS-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a6e25e20aaf4142efaff83075db24446eaa539c70177201b2690e3a5f74df84a
3
+ size 13339615392
Mixtral-8x22B-v0.1.IQ3_XS-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91b2eaf3710f06fb68e8b39c0f0e2aac25a74040254b685e48baf47f5139b45a
3
+ size 5614673216
Mixtral-8x22B-v0.1.Q2_K-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8df57105771bcdb84e12ead7bb878f1bf1bb6b4bc7559ee28dc94b59849480c0
3
+ size 11843728352
Mixtral-8x22B-v0.1.Q2_K-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6789b187d6a46603dc003ea64a0fbe1f9e8a5c98235e0f7e7b57dea3583496c
3
+ size 12267708608
Mixtral-8x22B-v0.1.Q2_K-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d82bd120f482f850e3637f9c5dae991c6f8944cbce46b899ee7c2886bf9d0e1
3
+ size 11188527232
Mixtral-8x22B-v0.1.Q2_K-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a46084f740321c8aa44faee95a93373098921f41ef47bf6679b83458dd16dad4
3
+ size 12016738464
Mixtral-8x22B-v0.1.Q2_K-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee8b387d29377f9ce22d41b2cd9075eeb573a484bbbec403d28d0edaf248f87f
3
+ size 4786462016