Hugging Face's logo

LiteLLMs
/
Mixtral-8x22B-v0.1-GGUF

GGUF
Mixture of Experts
GGUF
Eval Results
Inference Endpoints
Model card Files Community
1
andrijdavid commited on
Commit
4c9bed8
•
1 Parent(s): f824188

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00001-of-00009.gguf +3 -0
  3. Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00002-of-00009.gguf +3 -0
  4. Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00003-of-00009.gguf +3 -0
  5. Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00004-of-00009.gguf +3 -0
  6. Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00005-of-00009.gguf +3 -0
  7. Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00006-of-00009.gguf +3 -0
  8. Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00007-of-00009.gguf +3 -0
  9. Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00008-of-00009.gguf +3 -0
  10. Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00009-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -104,3 +104,12 @@ Q4_1/Mixtral-8x22B-v0.1-Q4_1-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -
104
  Q4_1/Mixtral-8x22B-v0.1-Q4_1-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
105
  Q4_1/Mixtral-8x22B-v0.1-Q4_1-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
106
  Q4_1/Mixtral-8x22B-v0.1-Q4_1-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
104
  Q4_1/Mixtral-8x22B-v0.1-Q4_1-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
105
  Q4_1/Mixtral-8x22B-v0.1-Q4_1-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
106
  Q4_1/Mixtral-8x22B-v0.1-Q4_1-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
107
+ Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
108
+ Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
109
+ Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
110
+ Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
111
+ Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
112
+ Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
113
+ Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
114
+ Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
115
+ Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff89cf7ccbf24c45a870dd5200e9174915a4a82b67e69aecc7d77220ec97d6eb
3
+ size 657638080
Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b04d798f4c5406b4418e189076bf1e9751f47f4b2e7f34ae7242c65a895b1680
3
+ size 546426752
Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37336ed47d866bdbc215c1520e87992faca97f164df992ec2c3b5a850b182501
3
+ size 553013120
Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e5984a3adff708be0663ab970a0013251f64e2ca94172425e885fc10db200f98
3
+ size 572280704
Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec01850068020ff0fc13aed3fe236c3d2d539b33470a9add5f9eb646df15f962
3
+ size 567562112
Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88e6938b5a6dab69e7e7d6d8fef25a4985699918fea2b84ef1cfb1134835e56a
3
+ size 553013120
Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e349b83d528c6ca15e74cc56f899a9773571c6e0fe9bb10c5d67dc30247e1f2
3
+ size 24934900288
Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e6ef7837c0b39839f0a87849d25c931b427c38794528ad7e9ca35f03412d095
3
+ size 28991034112
Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:425a3c94fa5354880f80999f0b016ded22bb4c1d461932c2f7c120be4044c83d
3
+ size 23102230336