Hugging Face's logo

bartowski
/
Mixtral-8x22B-v0.1-GGUF

Text Generation
Transformers
GGUF
5 languages
mixtral
Mixture of Experts
Inference Endpoints
text-generation-inference
Model card Files Community
3
bartowski commited on
Commit
7f550c2
•
1 Parent(s): c64bfdc

Llamacpp quants

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +65 -0
  2. Mixtral-8x22B-v0.1-IQ3_M-00001-of-00005.gguf +3 -0
  3. Mixtral-8x22B-v0.1-IQ3_M-00002-of-00005.gguf +3 -0
  4. Mixtral-8x22B-v0.1-IQ3_M-00003-of-00005.gguf +3 -0
  5. Mixtral-8x22B-v0.1-IQ3_M-00004-of-00005.gguf +3 -0
  6. Mixtral-8x22B-v0.1-IQ3_M-00005-of-00005.gguf +3 -0
  7. Mixtral-8x22B-v0.1-IQ3_S-00001-of-00005.gguf +3 -0
  8. Mixtral-8x22B-v0.1-IQ3_S-00002-of-00005.gguf +3 -0
  9. Mixtral-8x22B-v0.1-IQ3_S-00003-of-00005.gguf +3 -0
  10. Mixtral-8x22B-v0.1-IQ3_S-00004-of-00005.gguf +3 -0
  11. Mixtral-8x22B-v0.1-IQ3_S-00005-of-00005.gguf +3 -0
  12. Mixtral-8x22B-v0.1-IQ3_XS-00001-of-00005.gguf +3 -0
  13. Mixtral-8x22B-v0.1-IQ3_XS-00002-of-00005.gguf +3 -0
  14. Mixtral-8x22B-v0.1-IQ3_XS-00003-of-00005.gguf +3 -0
  15. Mixtral-8x22B-v0.1-IQ3_XS-00004-of-00005.gguf +3 -0
  16. Mixtral-8x22B-v0.1-IQ3_XS-00005-of-00005.gguf +3 -0
  17. Mixtral-8x22B-v0.1-IQ4_NL-00001-of-00005.gguf +3 -0
  18. Mixtral-8x22B-v0.1-IQ4_NL-00002-of-00005.gguf +3 -0
  19. Mixtral-8x22B-v0.1-IQ4_NL-00003-of-00005.gguf +3 -0
  20. Mixtral-8x22B-v0.1-IQ4_NL-00004-of-00005.gguf +3 -0
  21. Mixtral-8x22B-v0.1-IQ4_NL-00005-of-00005.gguf +3 -0
  22. Mixtral-8x22B-v0.1-IQ4_XS-00001-of-00005.gguf +3 -0
  23. Mixtral-8x22B-v0.1-IQ4_XS-00002-of-00005.gguf +3 -0
  24. Mixtral-8x22B-v0.1-IQ4_XS-00003-of-00005.gguf +3 -0
  25. Mixtral-8x22B-v0.1-IQ4_XS-00004-of-00005.gguf +3 -0
  26. Mixtral-8x22B-v0.1-IQ4_XS-00005-of-00005.gguf +3 -0
  27. Mixtral-8x22B-v0.1-Q2_K-00001-of-00005.gguf +3 -0
  28. Mixtral-8x22B-v0.1-Q2_K-00002-of-00005.gguf +3 -0
  29. Mixtral-8x22B-v0.1-Q2_K-00003-of-00005.gguf +3 -0
  30. Mixtral-8x22B-v0.1-Q2_K-00004-of-00005.gguf +3 -0
  31. Mixtral-8x22B-v0.1-Q2_K-00005-of-00005.gguf +3 -0
  32. Mixtral-8x22B-v0.1-Q3_K_L-00001-of-00005.gguf +3 -0
  33. Mixtral-8x22B-v0.1-Q3_K_L-00002-of-00005.gguf +3 -0
  34. Mixtral-8x22B-v0.1-Q3_K_L-00003-of-00005.gguf +3 -0
  35. Mixtral-8x22B-v0.1-Q3_K_L-00004-of-00005.gguf +3 -0
  36. Mixtral-8x22B-v0.1-Q3_K_L-00005-of-00005.gguf +3 -0
  37. Mixtral-8x22B-v0.1-Q3_K_M-00001-of-00005.gguf +3 -0
  38. Mixtral-8x22B-v0.1-Q3_K_M-00002-of-00005.gguf +3 -0
  39. Mixtral-8x22B-v0.1-Q3_K_M-00003-of-00005.gguf +3 -0
  40. Mixtral-8x22B-v0.1-Q3_K_M-00004-of-00005.gguf +3 -0
  41. Mixtral-8x22B-v0.1-Q3_K_M-00005-of-00005.gguf +3 -0
  42. Mixtral-8x22B-v0.1-Q3_K_S-00001-of-00005.gguf +3 -0
  43. Mixtral-8x22B-v0.1-Q3_K_S-00002-of-00005.gguf +3 -0
  44. Mixtral-8x22B-v0.1-Q3_K_S-00003-of-00005.gguf +3 -0
  45. Mixtral-8x22B-v0.1-Q3_K_S-00004-of-00005.gguf +3 -0
  46. Mixtral-8x22B-v0.1-Q3_K_S-00005-of-00005.gguf +3 -0
  47. Mixtral-8x22B-v0.1-Q4_K_M-00001-of-00005.gguf +3 -0
  48. Mixtral-8x22B-v0.1-Q4_K_M-00002-of-00005.gguf +3 -0
  49. Mixtral-8x22B-v0.1-Q4_K_M-00003-of-00005.gguf +3 -0
  50. Mixtral-8x22B-v0.1-Q4_K_M-00004-of-00005.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,68 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Mixtral-8x22B-v0.1-IQ3_M-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Mixtral-8x22B-v0.1-IQ3_M-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Mixtral-8x22B-v0.1-IQ3_M-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Mixtral-8x22B-v0.1-IQ3_M-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Mixtral-8x22B-v0.1-IQ3_M-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Mixtral-8x22B-v0.1-IQ3_S-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Mixtral-8x22B-v0.1-IQ3_S-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Mixtral-8x22B-v0.1-IQ3_S-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Mixtral-8x22B-v0.1-IQ3_S-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Mixtral-8x22B-v0.1-IQ3_S-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Mixtral-8x22B-v0.1-IQ3_XS-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Mixtral-8x22B-v0.1-IQ3_XS-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Mixtral-8x22B-v0.1-IQ3_XS-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Mixtral-8x22B-v0.1-IQ3_XS-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Mixtral-8x22B-v0.1-IQ3_XS-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Mixtral-8x22B-v0.1-IQ4_NL-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Mixtral-8x22B-v0.1-IQ4_NL-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Mixtral-8x22B-v0.1-IQ4_NL-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Mixtral-8x22B-v0.1-IQ4_NL-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Mixtral-8x22B-v0.1-IQ4_NL-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Mixtral-8x22B-v0.1-IQ4_XS-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Mixtral-8x22B-v0.1-IQ4_XS-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Mixtral-8x22B-v0.1-IQ4_XS-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Mixtral-8x22B-v0.1-IQ4_XS-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Mixtral-8x22B-v0.1-IQ4_XS-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
61
+ Mixtral-8x22B-v0.1-Q2_K-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
62
+ Mixtral-8x22B-v0.1-Q2_K-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
63
+ Mixtral-8x22B-v0.1-Q2_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
64
+ Mixtral-8x22B-v0.1-Q2_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
65
+ Mixtral-8x22B-v0.1-Q2_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
66
+ Mixtral-8x22B-v0.1-Q3_K_L-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
67
+ Mixtral-8x22B-v0.1-Q3_K_L-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
68
+ Mixtral-8x22B-v0.1-Q3_K_L-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
69
+ Mixtral-8x22B-v0.1-Q3_K_L-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
70
+ Mixtral-8x22B-v0.1-Q3_K_L-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
71
+ Mixtral-8x22B-v0.1-Q3_K_M-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
72
+ Mixtral-8x22B-v0.1-Q3_K_M-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
73
+ Mixtral-8x22B-v0.1-Q3_K_M-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
74
+ Mixtral-8x22B-v0.1-Q3_K_M-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
75
+ Mixtral-8x22B-v0.1-Q3_K_M-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
76
+ Mixtral-8x22B-v0.1-Q3_K_S-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
77
+ Mixtral-8x22B-v0.1-Q3_K_S-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
78
+ Mixtral-8x22B-v0.1-Q3_K_S-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
79
+ Mixtral-8x22B-v0.1-Q3_K_S-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
80
+ Mixtral-8x22B-v0.1-Q3_K_S-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
81
+ Mixtral-8x22B-v0.1-Q4_K_M-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
82
+ Mixtral-8x22B-v0.1-Q4_K_M-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
83
+ Mixtral-8x22B-v0.1-Q4_K_M-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
84
+ Mixtral-8x22B-v0.1-Q4_K_M-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
85
+ Mixtral-8x22B-v0.1-Q4_K_M-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
86
+ Mixtral-8x22B-v0.1-Q4_K_S-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
87
+ Mixtral-8x22B-v0.1-Q4_K_S-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
88
+ Mixtral-8x22B-v0.1-Q4_K_S-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
89
+ Mixtral-8x22B-v0.1-Q4_K_S-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
90
+ Mixtral-8x22B-v0.1-Q4_K_S-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
91
+ Mixtral-8x22B-v0.1-Q5_K_M-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
92
+ Mixtral-8x22B-v0.1-Q5_K_M-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
93
+ Mixtral-8x22B-v0.1-Q5_K_M-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
94
+ Mixtral-8x22B-v0.1-Q5_K_M-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
95
+ Mixtral-8x22B-v0.1-Q5_K_M-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
96
+ Mixtral-8x22B-v0.1-Q5_K_S-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
97
+ Mixtral-8x22B-v0.1-Q5_K_S-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
98
+ Mixtral-8x22B-v0.1-Q5_K_S-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
99
+ Mixtral-8x22B-v0.1-Q5_K_S-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
100
+ Mixtral-8x22B-v0.1-Q5_K_S-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Mixtral-8x22B-v0.1-IQ3_M-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc931c7593a5bbee1834c0807f077fe3bed0a7862b262408f7b64ca8be2d7ccd
3
+ size 14920852448
Mixtral-8x22B-v0.1-IQ3_M-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c3e8298442bcabfa7816faa09e703ba9f43da32e9036157e2e14e0d5dcd1570c
3
+ size 14953668800
Mixtral-8x22B-v0.1-IQ3_M-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd8563ae9f9626382cea65490b7b82b4dcad666fb2a4002d086a56c75059947a
3
+ size 13625286784
Mixtral-8x22B-v0.1-IQ3_M-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec1abb14c3ba40f654f56bf989fb0c258413c9d2dae33c65b6024295440a963f
3
+ size 14834819232
Mixtral-8x22B-v0.1-IQ3_M-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3445c47f544c250905ba21f4a396bbd0efdb123a8480791b582615da4aa68639
3
+ size 6158294336
Mixtral-8x22B-v0.1-IQ3_S-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:293eda1e4dc015533be891628cef69a9c15de3abdc11b6062d4539be6ec757c3
3
+ size 13958259680
Mixtral-8x22B-v0.1-IQ3_S-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f09a0e009b5bbd95e0b00af02ff679169ec2dd66d74105282d56030b6e09def0
3
+ size 14525849792
Mixtral-8x22B-v0.1-IQ3_S-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:16ca1896197db10a887e1a6d9ab968d490ae5a05a84136661a9e7bb73694815c
3
+ size 13197467776
Mixtral-8x22B-v0.1-IQ3_S-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15b499d56096992c80bc855a0c3f85810ff5876157e77fd81784cc90851102b0
3
+ size 14193090720
Mixtral-8x22B-v0.1-IQ3_S-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2ea323edb75fa2235b345f59b4f9dacf575e84974b45d50099bc8353ac73897
3
+ size 5623520576
Mixtral-8x22B-v0.1-IQ3_XS-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b242bb1c5a264545daa11a38c33b55991cd6d57adb86b946b440aac17af2a4f
3
+ size 13520020448
Mixtral-8x22B-v0.1-IQ3_XS-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c99a4cb2b1365b52f067a9555335aa0e1ffe0e53ba51d154ef9e5feef46161da
3
+ size 13483630784
Mixtral-8x22B-v0.1-IQ3_XS-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:efce33e4670050bb3c487f70d8f94d9d94d432060c98c598efde72b17624412e
3
+ size 12270264448
Mixtral-8x22B-v0.1-IQ3_XS-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a6e25e20aaf4142efaff83075db24446eaa539c70177201b2690e3a5f74df84a
3
+ size 13339615392
Mixtral-8x22B-v0.1-IQ3_XS-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91b2eaf3710f06fb68e8b39c0f0e2aac25a74040254b685e48baf47f5139b45a
3
+ size 5614673216
Mixtral-8x22B-v0.1-IQ4_NL-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6fa299be6b042a545269cdac15fea43372028b0ec4a60426c7ee2ed59d44370a
3
+ size 18818470880
Mixtral-8x22B-v0.1-IQ4_NL-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f46ea07e1ad425f8bed6f53dcf207054c054ecb7e907f75264c552b8466faf1
3
+ size 18869215424
Mixtral-8x22B-v0.1-IQ4_NL-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:64add9ad48057ac2bce8fa415268fd863d3581e7628dccc57ae779090da8ceff
3
+ size 17108000896
Mixtral-8x22B-v0.1-IQ4_NL-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:137351e0f7b83345e6eab22d169d063adac598fb6897864ba382a21368342025
3
+ size 18429501600
Mixtral-8x22B-v0.1-IQ4_NL-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69b37e830d38f062b74989320acb98e90dd6064332c38c9f807aed1b71859180
3
+ size 7252909376
Mixtral-8x22B-v0.1-IQ4_XS-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce6d9b73714b4b7d8192b83ad423558d0f6346d14ed15262faca57a1084ba7ed
3
+ size 18016850912
Mixtral-8x22B-v0.1-IQ4_XS-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c1a17f62cae09402f1a20f24d84a2a9205624fb77d8dbccb593d619e19dc3f9
3
+ size 17847247040
Mixtral-8x22B-v0.1-IQ4_XS-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe0aa1d0f75a31becee1ee55bcf0a1c5e83fcd6156adbfbfb1099e330098d031
3
+ size 16187875456
Mixtral-8x22B-v0.1-IQ4_XS-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b60f09de85cea619671f997d88528388dbce38783440ed2e8ba9155e477c72d9
3
+ size 17432699040
Mixtral-8x22B-v0.1-IQ4_XS-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:16ee29c4f479b5786c5f5799141351f0e0eb10a1744afac9b68f8c1cc6467552
3
+ size 6869523776
Mixtral-8x22B-v0.1-Q2_K-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c0c7802ad137326100038586276e5bbe535dc3f0d993708b3782c8bdf5a7a651
3
+ size 11843728352
Mixtral-8x22B-v0.1-Q2_K-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6789b187d6a46603dc003ea64a0fbe1f9e8a5c98235e0f7e7b57dea3583496c
3
+ size 12267708608
Mixtral-8x22B-v0.1-Q2_K-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d82bd120f482f850e3637f9c5dae991c6f8944cbce46b899ee7c2886bf9d0e1
3
+ size 11188527232
Mixtral-8x22B-v0.1-Q2_K-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a46084f740321c8aa44faee95a93373098921f41ef47bf6679b83458dd16dad4
3
+ size 12016738464
Mixtral-8x22B-v0.1-Q2_K-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee8b387d29377f9ce22d41b2cd9075eeb573a484bbbec403d28d0edaf248f87f
3
+ size 4786462016
Mixtral-8x22B-v0.1-Q3_K_L-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5ffd7768aba8bf9cb0e37c4db819cb35102fdbe5e199d447b18978963368985
3
+ size 16530777056
Mixtral-8x22B-v0.1-Q3_K_L-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa18a7f4b57ff121ea5ec5d0b90e9590b08a3eaf3e0556c34bc4699b6c003169
3
+ size 17108099264
Mixtral-8x22B-v0.1-Q3_K_L-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a6cc157ea6cd0e2d1c4a561e36eb0471d0df4c8f07332e569e740583a5505a5
3
+ size 15552635008
Mixtral-8x22B-v0.1-Q3_K_L-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:214c0dd6cee4a6f1c0174d404dd029382a9d603db4b0e4c4b8e38564633bd205
3
+ size 16775340192
Mixtral-8x22B-v0.1-Q3_K_L-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:295691f81b4deab5376796a897096408d475f0223b09420452edbc3d7f2ab71b
3
+ size 6612950336
Mixtral-8x22B-v0.1-Q3_K_M-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6060b14708e9615e4fe9f3ed423dc1fb259b0b77c148fac4c4035e4fd8bbac8
3
+ size 15650661344
Mixtral-8x22B-v0.1-Q3_K_M-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00931e7400dc81527281066d3d7e3f4a491e73b3061dfb53408087142fa6f9b3
3
+ size 15916261568
Mixtral-8x22B-v0.1-Q3_K_M-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b4710a6d2131ee239badd8d010db26de2b7577285404e029fb1cc7d8a3430a2
3
+ size 14480924800
Mixtral-8x22B-v0.1-Q3_K_M-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc0cf400eddf2d7aebda732fe3f6089376bc0aad914b7cf9cf223d94c5e06c59
3
+ size 15583502496
Mixtral-8x22B-v0.1-Q3_K_M-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2059817532275080ea7d759a863984970683a21e99e966c05986b9e21295db0
3
+ size 6158294336
Mixtral-8x22B-v0.1-Q3_K_S-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1429ed3864ccb00803b50eabc9e80e3363bd82c829ad393c3c16039c8ec7ed8
3
+ size 13958259680
Mixtral-8x22B-v0.1-Q3_K_S-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ab8c9ee1f9cd86581008faa86734e7fe7ec893451aed20ae246582bc181386c
3
+ size 14525849792
Mixtral-8x22B-v0.1-Q3_K_S-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:404849e60d18e85b40fd932f192645c3e1a5beefd0d624ed53d3a2943ad764ce
3
+ size 13197467776
Mixtral-8x22B-v0.1-Q3_K_S-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:30804f139dfb519c5dce736b18945408ef68607bdb70f613995c95aa245bd696
3
+ size 14193090720
Mixtral-8x22B-v0.1-Q3_K_S-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1f6ee01cb68159bd6fbc4eede54f050f6c07aa416efb1fb0b6b89fd80f64a6f
3
+ size 5623520576
Mixtral-8x22B-v0.1-Q4_K_M-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55862ec7a8a7fd62f43834a31b3b1ecac63d7fa00a61c912894f12278618ea48
3
+ size 19982390240
Mixtral-8x22B-v0.1-Q4_K_M-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:679ead1db846f7276f81176f209b4afa9ad263a79e80eae781379d5bf9ed314f
3
+ size 19699687616
Mixtral-8x22B-v0.1-Q4_K_M-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee4cdc2f405ff7dad2e19becd36ff8d332072e8c77d23524eee2bfcc2e2a555a
3
+ size 17938473088
Mixtral-8x22B-v0.1-Q4_K_M-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:889ecc23442bb45d6b3d0db396889d42191dcbfb644abbb11a2d87146bc2c37a
3
+ size 19675209888