Hugging Face's logo

second-state
/
Mixtral-8x7B-Instruct-v0.1-GGUF

Text Generation
Transformers
GGUF
5 languages
mixtral
text-generation-inference
Model card Files Community
Xin Liu commited on
Commit
4bbcaef
•
1 Parent(s): 37d4496

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (10) hide show
  1. Mixtral-8x7B-Instruct-v0.1-Q3_K_L.gguf +3 -0
  2. Mixtral-8x7B-Instruct-v0.1-Q3_K_M.gguf +3 -0
  3. Mixtral-8x7B-Instruct-v0.1-Q3_K_S.gguf +3 -0
  4. Mixtral-8x7B-Instruct-v0.1-Q4_0.gguf +3 -0
  5. Mixtral-8x7B-Instruct-v0.1-Q4_K_M.gguf +3 -0
  6. Mixtral-8x7B-Instruct-v0.1-Q4_K_S.gguf +3 -0
  7. Mixtral-8x7B-Instruct-v0.1-Q5_0.gguf +3 -0
  8. Mixtral-8x7B-Instruct-v0.1-Q5_K_S.gguf +3 -0
  9. Mixtral-8x7B-Instruct-v0.1-Q6_K.gguf +3 -0
  10. Mixtral-8x7B-Instruct-v0.1-Q8_0.gguf +3 -0
Mixtral-8x7B-Instruct-v0.1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e00697bc004cd19b2b6c3b1f8da70283559be1457b5c9a8b74fdc146d9229b9
3
+ size 24167589760
Mixtral-8x7B-Instruct-v0.1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9728d89750c879bc2bab36a105bfb1c2ce93675b38938ba750d32deb6d09f75
3
+ size 22544394112
Mixtral-8x7B-Instruct-v0.1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e685c729b482a0fba3f7560cd20235569937c55fde9a79526bfc8271ed16d88d
3
+ size 20430464896
Mixtral-8x7B-Instruct-v0.1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a66f440f631d56d54a3ee444448c98d7e3ba44d58c32fb00852d25e72bbcd369
3
+ size 26441533312
Mixtral-8x7B-Instruct-v0.1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f82f5e18140c1b715d97623b8d3d2453252d0517e1bc3f53e7828362c6e50137
3
+ size 28446410624
Mixtral-8x7B-Instruct-v0.1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d758d872813b4006b12334f9881fd1babb678643925889e926cbf6435ce98181
3
+ size 26743523200
Mixtral-8x7B-Instruct-v0.1-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c912687e8c1d0093b24420f57490e5676c742e59c0cd2632d9d78899cc973755
3
+ size 32229279616
Mixtral-8x7B-Instruct-v0.1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d6f69cbed2dc3b46d73d340250346809eca7e214fe050c8339f450208775060
3
+ size 32229279616
Mixtral-8x7B-Instruct-v0.1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6aa6a3a2a576fe549e136e1f17ef1cb7627e7d2b337a0cb06d675ffb66ba7be3
3
+ size 38378760064
Mixtral-8x7B-Instruct-v0.1-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b738afcd7892b22286377f4c25ba70dbefad5e8ff3d33dba64767b640f4884b1
3
+ size 49624262528