Hugging Face's logo

LiteLLMs
/
Mixtral-8x22B-v0.1-GGUF

GGUF
Mixture of Experts
GGUF
Eval Results
Inference Endpoints
Model card Files Community
1
andrijdavid commited on
Commit
5703b77
•
1 Parent(s): 4c9bed8

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00001-of-00009.gguf +3 -0
  3. Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00002-of-00009.gguf +3 -0
  4. Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00003-of-00009.gguf +3 -0
  5. Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00004-of-00009.gguf +3 -0
  6. Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00005-of-00009.gguf +3 -0
  7. Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00006-of-00009.gguf +3 -0
  8. Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00007-of-00009.gguf +3 -0
  9. Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00008-of-00009.gguf +3 -0
  10. Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00009-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -113,3 +113,12 @@ Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00006-of-00009.gguf filter=lfs diff=lfs merge=l
113
  Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
114
  Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
115
  Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
113
  Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
114
  Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
115
  Q4_K_S/Mixtral-8x22B-v0.1-Q4_K_S-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
116
+ Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
117
+ Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
118
+ Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
119
+ Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
120
+ Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
121
+ Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
122
+ Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
123
+ Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
124
+ Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2a8838b67a01d17f2fc6c3a1425f56468b1377d795b7a9ae732dadeb02b03686
3
+ size 657638080
Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b04d798f4c5406b4418e189076bf1e9751f47f4b2e7f34ae7242c65a895b1680
3
+ size 546426752
Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37336ed47d866bdbc215c1520e87992faca97f164df992ec2c3b5a850b182501
3
+ size 553013120
Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e5984a3adff708be0663ab970a0013251f64e2ca94172425e885fc10db200f98
3
+ size 572280704
Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec01850068020ff0fc13aed3fe236c3d2d539b33470a9add5f9eb646df15f962
3
+ size 567562112
Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88e6938b5a6dab69e7e7d6d8fef25a4985699918fea2b84ef1cfb1134835e56a
3
+ size 553013120
Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2724c24f00f2ff3645842cfc67661bf611760bab97ded2d052d8a987e88150e
3
+ size 26306437696
Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37dce304700840ef3283ab8a81e55fe73dad9d24329e798b61dfce1cb4da233f
3
+ size 30444360448
Q4_K_M/Mixtral-8x22B-v0.1-Q4_K_M-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4863d4f222f67448b8db11f801ae3cabb4a277141955d3d7236aeb8ad81d66b2
3
+ size 25386028864