Hugging Face's logo

LiteLLMs
/
Mixtral-8x22B-v0.1-GGUF

GGUF
Mixture of Experts
GGUF
Eval Results
Inference Endpoints
Model card Files Community
1
andrijdavid commited on
Commit
aee3300
•
1 Parent(s): 11a0619

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00001-of-00009.gguf +3 -0
  3. Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00002-of-00009.gguf +3 -0
  4. Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00003-of-00009.gguf +3 -0
  5. Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00004-of-00009.gguf +3 -0
  6. Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00005-of-00009.gguf +3 -0
  7. Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00006-of-00009.gguf +3 -0
  8. Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00007-of-00009.gguf +3 -0
  9. Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00008-of-00009.gguf +3 -0
  10. Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00009-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -149,3 +149,12 @@ Q5_K_M/Mixtral-8x22B-v0.1-Q5_K_M-00006-of-00009.gguf filter=lfs diff=lfs merge=l
149
  Q5_K_M/Mixtral-8x22B-v0.1-Q5_K_M-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
150
  Q5_K_M/Mixtral-8x22B-v0.1-Q5_K_M-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
151
  Q5_K_M/Mixtral-8x22B-v0.1-Q5_K_M-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
149
  Q5_K_M/Mixtral-8x22B-v0.1-Q5_K_M-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
150
  Q5_K_M/Mixtral-8x22B-v0.1-Q5_K_M-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
151
  Q5_K_M/Mixtral-8x22B-v0.1-Q5_K_M-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
152
+ Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
153
+ Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
154
+ Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
155
+ Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
156
+ Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
157
+ Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
158
+ Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
159
+ Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
160
+ Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc95320f1435bc8d393e28fd343afff87d6163de3d6084828a0ab0538a5809c5
3
+ size 724681408
Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00ae6bdaa6d91f22732d968ca8ebf9f44c75bef6ad78db2571c06b3de97b5c70
3
+ size 588894080
Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b282b303147bf756b875c6a8a69d94a5c3fa701246d9b02c44e48ddc69734d6c
3
+ size 595480448
Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a8d4525e7ae483a846ad80c44f72a8ee3c1aab7f4ed554487d117a86743c417f
3
+ size 614748032
Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a73440a63a4c1df32699c5342373b5b2c7b7e327384f553e349fe46652dcff3
3
+ size 614748032
Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82fa398651d69af839117c1bc679bbb66785368a06c8c994b913e2d6d888e702
3
+ size 595480448
Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bbeb5de1bf055ac5d215ae5d35d23534820c417345b970d392f1c30e913cb4b1
3
+ size 29570130496
Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:877dc3f52cc5d66a56b3d16b41ab9bb7b3ec1d78615774093874625c7605ca65
3
+ size 35433485056
Q5_K_S/Mixtral-8x22B-v0.1-Q5_K_S-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b85473ee9923b0346eada5a0ef5e1d4ab8e8b1e3a2bd18b95791d72e18471fcc
3
+ size 28236058432