Hugging Face's logo

LiteLLMs
/
Mixtral-8x22B-v0.1-GGUF

GGUF
Mixture of Experts
GGUF
Eval Results
Inference Endpoints
Model card Files Community
1
andrijdavid commited on
Commit
92868ce
•
1 Parent(s): e357dd8

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00001-of-00009.gguf +3 -0
  3. IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00002-of-00009.gguf +3 -0
  4. IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00003-of-00009.gguf +3 -0
  5. IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00004-of-00009.gguf +3 -0
  6. IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00005-of-00009.gguf +3 -0
  7. IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00006-of-00009.gguf +3 -0
  8. IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00007-of-00009.gguf +3 -0
  9. IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00008-of-00009.gguf +3 -0
  10. IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00009-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -203,3 +203,12 @@ IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00006-of-00009.gguf filter=lfs diff=lfs merge=l
203
  IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
204
  IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
205
  IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
203
  IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
204
  IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
205
  IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
206
+ IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
207
+ IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
208
+ IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
209
+ IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
210
+ IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
211
+ IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
212
+ IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
213
+ IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
214
+ IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4311103eee10951b8269e8e7c55f29e99de62577360a1edcdfabf2036ed7c33
3
+ size 640877248
IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e423d24c6351ec66c7369a42c08b78c78eb6ecf43f741e3f0f0ed4d18ecb109
3
+ size 535809920
IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08da4be84135f78bcb3344236271a9006dc555cf9371607555a9e71564a7e4e3
3
+ size 542396288
IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b7234858a24ce3bc78eab3f4377cbb1c1c23d89be7e57d4560bb57be8724531
3
+ size 561663872
IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:528c217372702c953c04c0e637d0f79a08b7c9382b309976185aca33059389af
3
+ size 555765632
IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7066a25eb4fb9594a40497475277545c7028189d9abef49b34a4d6fa3cf01c4
3
+ size 542396288
IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:316444c35dc2fc6174a8aa7c46d15e1d8d1c5208674dbcdc1f6125c24ecdeb07
3
+ size 23776092736
IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7406005c2a087d909835f4ac5a1f018833f768d4e0acd44a74b566b2bd655f02
3
+ size 27380421376
IQ4_XS/Mixtral-8x22B-v0.1-IQ4_XS-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:615d082b60e34c2ac51c3aef76cd60478894f42790eaba76d28048798137d17c
3
+ size 21818773312