Hugging Face's logo

MaziyarPanahi
/
Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation
GGUF
5 languages
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
mixtral
Mixture of Experts
Model card Files Community
36
MaziyarPanahi commited on
Commit
0f12d93
•
1 Parent(s): be06e5b

Upload folder using huggingface_hub (#29)

Browse files

- adcd28f0c4cc4417afc4b05267c751dc0a3fdf1fab1a13c6b526d7beb30dad64 (2cc6335bcbe1f42cb9b0b0a6cd676076cb541808)
- 273391420718a432191416b850bd80398cf04cddd83dcccf9484ca173c52770f (42bbbd66c26756b16b132b812c4f95f122fc0800)
- 73712bd14a47000db9d0cdedd3b2c3e33f8165fa7c5c9d12ff609366afcc5b45 (7fd048645ec13e1cf105e18cf7ad19f9c556a7b5)
- 682d9e83a696398fac9946a31c8a109533640011360228583660bf796cb6f424 (aa3b7ba4a4a3df028ae2178ce71f494d44599edf)
- 92ba52c43e312ea398092512c19013726e5d5e86fa57ec97ed4752d8814d2b6e (274990398fc4bda9edd74e91a9fcd13dc0f018f6)
- 9e36b79b1089b243983c9dc8d05ce2758bbaa42b68c539a329d90bdf7ac010bc (758b181862136023a1cd8db1418ec1d61b82012e)
- e903cb6ee6909a31d27769c7f433e8349484beccbbb3f0587998a948d2ecd09d (38b1d64ca3b196ee0f991f1c6851749df0fbc425)
- d91cecdbf8ed22ddf47b1bb0b85d54c7e04788b1f749214962709bb3e6ce2e2a (6019483b0a5eff0e354bdfdbbceedadd8f3ecd9b)

Files changed (9) hide show
  1. .gitattributes +8 -0
  2. Mixtral-8x22B-Instruct-v0.1.Q6-00001-of-00004.gguf +3 -0
  3. Mixtral-8x22B-Instruct-v0.1.Q6-00002-of-00004.gguf +3 -0
  4. Mixtral-8x22B-Instruct-v0.1.Q6-00003-of-00004.gguf +3 -0
  5. Mixtral-8x22B-Instruct-v0.1.Q6-00004-of-00004.gguf +3 -0
  6. Mixtral-8x22B-Instruct-v0.1.Q8_0-00001-of-00004.gguf +3 -0
  7. Mixtral-8x22B-Instruct-v0.1.Q8_0-00002-of-00004.gguf +3 -0
  8. Mixtral-8x22B-Instruct-v0.1.Q8_0-00003-of-00004.gguf +3 -0
  9. Mixtral-8x22B-Instruct-v0.1.Q8_0-00004-of-00004.gguf +3 -0
.gitattributes CHANGED
@@ -85,3 +85,11 @@ Mixtral-8x22B-Instruct-v0.1.Q5_K_S-00001-of-00004.gguf filter=lfs diff=lfs merge
85
  Mixtral-8x22B-Instruct-v0.1.Q5_K_S-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
86
  Mixtral-8x22B-Instruct-v0.1.Q5_K_S-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
87
  Mixtral-8x22B-Instruct-v0.1.Q5_K_S-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
85
  Mixtral-8x22B-Instruct-v0.1.Q5_K_S-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
86
  Mixtral-8x22B-Instruct-v0.1.Q5_K_S-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
87
  Mixtral-8x22B-Instruct-v0.1.Q5_K_S-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
88
+ Mixtral-8x22B-Instruct-v0.1.Q6-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
89
+ Mixtral-8x22B-Instruct-v0.1.Q6-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
90
+ Mixtral-8x22B-Instruct-v0.1.Q6-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
91
+ Mixtral-8x22B-Instruct-v0.1.Q6-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
92
+ Mixtral-8x22B-Instruct-v0.1.Q8_0-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
93
+ Mixtral-8x22B-Instruct-v0.1.Q8_0-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
94
+ Mixtral-8x22B-Instruct-v0.1.Q8_0-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
95
+ Mixtral-8x22B-Instruct-v0.1.Q8_0-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Mixtral-8x22B-Instruct-v0.1.Q6-00001-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dea804f715df225804f8546aeeeaf72171e70c46d6f1f612dbfdb9a2ec094a81
3
+ size 31024730784
Mixtral-8x22B-Instruct-v0.1.Q6-00002-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e8fe4958617242b433276f69152708c5416bf4371b733c5028234b80f0d71ad
3
+ size 30858864160
Mixtral-8x22B-Instruct-v0.1.Q6-00003-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:56660563639721ffb5429e243e10824118750b8d2a3dead666b4d12aee59303d
3
+ size 30858864160
Mixtral-8x22B-Instruct-v0.1.Q6-00004-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ecf2e0a60f9663bf7d2e67b8e53a2723ed15bcd92c619af2125bfcb631fbe22c
3
+ size 22795033792
Mixtral-8x22B-Instruct-v0.1.Q8_0-00001-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79e1fd27160a1423a7a1358eca3bb83a48efca7b9e8473202e8fc0a55443c808
3
+ size 40124338848
Mixtral-8x22B-Instruct-v0.1.Q8_0-00002-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2da7cb0485db544d972626729481f5afea71d5d2ebe6d4f797a8c15e89fad165
3
+ size 39909713440
Mixtral-8x22B-Instruct-v0.1.Q8_0-00003-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76e92dfc1050f7355c0a7fdd3cb6eee5147cb3810eaec52750459863207d302c
3
+ size 39909713440
Mixtral-8x22B-Instruct-v0.1.Q8_0-00004-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5b15fc488c62232d0d5691980d7d197f67ad467ec844887d5f6e462c23ccf76
3
+ size 29481082048