Hugging Face's logo

LiteLLMs
/
Mixtral-8x22B-v0.1-GGUF

GGUF
Mixture of Experts
GGUF
Eval Results
Inference Endpoints
Model card Files Community
1
andrijdavid commited on
Commit
e357dd8
•
1 Parent(s): 0e3ee67

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00001-of-00009.gguf +3 -0
  3. IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00002-of-00009.gguf +3 -0
  4. IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00003-of-00009.gguf +3 -0
  5. IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00004-of-00009.gguf +3 -0
  6. IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00005-of-00009.gguf +3 -0
  7. IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00006-of-00009.gguf +3 -0
  8. IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00007-of-00009.gguf +3 -0
  9. IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00008-of-00009.gguf +3 -0
  10. IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00009-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -194,3 +194,12 @@ IQ3_XS/Mixtral-8x22B-v0.1-IQ3_XS-00006-of-00009.gguf filter=lfs diff=lfs merge=l
194
  IQ3_XS/Mixtral-8x22B-v0.1-IQ3_XS-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
195
  IQ3_XS/Mixtral-8x22B-v0.1-IQ3_XS-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
196
  IQ3_XS/Mixtral-8x22B-v0.1-IQ3_XS-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
194
  IQ3_XS/Mixtral-8x22B-v0.1-IQ3_XS-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
195
  IQ3_XS/Mixtral-8x22B-v0.1-IQ3_XS-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
196
  IQ3_XS/Mixtral-8x22B-v0.1-IQ3_XS-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
197
+ IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
198
+ IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
199
+ IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
200
+ IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
201
+ IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
202
+ IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
203
+ IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
204
+ IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
205
+ IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:94f6fb1010a92535804681eca4ba27adf037bd748a0ada0117f87ed5bccab1f2
3
+ size 657638080
IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b2b66a9e1b8f6228ebfef2ad975924b639a0b121f90db365e32a6e7a09229994
3
+ size 546426752
IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa062f4a0962a512d93081163415c63d98236b1851d0cb726dd6b862a93a37f6
3
+ size 553013120
IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba2a5b19e523b096aedc20756b8f9a6a34be3b77b42d15f460763633bbea34ed
3
+ size 572280704
IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:85fe0986acc5000e54dc033905fad4c7d30ad6a7a4e778ce8936ede063b3ff29
3
+ size 567562112
IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ece538d4f86f935d796c9565815f6b3afd5e2abd284fe13a6dd832bb21b4ec4b
3
+ size 553013120
IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a0aa6e555b0f046ef8473a121b2fe69ec97189f773e66a447df8e93f3fdc6ef
3
+ size 24934900288
IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:85e9a79f305edf69c8ddb0467f13ece33b3e0478e0f8f134c5fc54fdb45dc5ae
3
+ size 28991034112
IQ4_NL/Mixtral-8x22B-v0.1-IQ4_NL-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:056f2f0844bade09849c3a9f5a7ef8c8f8ea97bfecc8896325115751ccd1e3c9
3
+ size 23102230336